2026-03-24 16:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-24 16:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-24 16:45:05 [ayvens.fr] INFO: Starting spider ayvens.fr
2026-03-24 16:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-24 16:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-24 16:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-24 16:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-24 16:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: 5245f8f914d1d04d
2026-03-24 16:45:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-24 16:45:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.fr/task_44_2026-03-24T16_45_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-24 16:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 16:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 16:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-24 16:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-24 16:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-24 16:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-24 16:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 16:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-24 16:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-24 16:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-24 16:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-24 16:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-24 16:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-24 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-24 16:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-24 16:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-24 16:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-24 16:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-24 16:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-24 16:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-24 16:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-24 16:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-24 16:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-24 16:45:12 [scrapy-playwright] INFO: Browser firefox launched
2026-03-24 16:45:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-24 16:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-24 16:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 16:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 16:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-ADG3G2OJ.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 16:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-24 16:45:18 [ayvens.fr] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'gcOrBn8vEwcuO3F/5Fbgmf|2026-03-24T16:45:16.561Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1805906716, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'BER60U5OUzl/aAl/cFLwxF|1774370718192|1774370718192', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774372518, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-24 16:45:18 [ayvens.fr] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'gcOrBn8vEwcuO3F/5Fbgmf|2026-03-24T16:45:16.561Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'BER60U5OUzl/aAl/cFLwxF|1774370718192|1774370718192', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-24 16:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-24 16:45:18 [ayvens.fr] INFO: Intercepting token...
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-24 16:45:18 [ayvens.fr] INFO: Scrolling element to trigger lazy load...
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-24 16:45:18 [ayvens.fr] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/nl.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/nl.svg>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-24 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 16:45:20 [ayvens.fr] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-24 16:45:20 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-24 16:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 16:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 16:45:23 [ayvens.fr] INFO: Found listing with ID: 1980609
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980609%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [ayvens.fr] INFO: Scrape type for 1980609: 1
2026-03-24 16:45:23 [ayvens.fr] INFO: Extracting data for car ID: 1980609
2026-03-24 16:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dfde11e-3cae-5652-a657-5b94098ae972 with identifier: 1980609
2026-03-24 16:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dfde11e-3cae-5652-a657-5b94098ae972 with scrape type 1
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/1.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/2.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/3.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/4.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/5.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/6.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/7.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/8.jpg not downloaded yet
2026-03-24 16:45:23 [ayvens.fr] INFO: Found listing with ID: 1980610
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980610%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [ayvens.fr] INFO: Scrape type for 1980610: 1
2026-03-24 16:45:23 [ayvens.fr] INFO: Extracting data for car ID: 1980610
2026-03-24 16:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32061d4a-c9f1-5b8d-9815-0827de4a160a with identifier: 1980610
2026-03-24 16:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32061d4a-c9f1-5b8d-9815-0827de4a160a with scrape type 1
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/1.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/2.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/3.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/4.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/5.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/6.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/7.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/8.jpg not downloaded yet
2026-03-24 16:45:23 [ayvens.fr] INFO: Found listing with ID: 1980611
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980611%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [ayvens.fr] INFO: Scrape type for 1980611: 1
2026-03-24 16:45:23 [ayvens.fr] INFO: Extracting data for car ID: 1980611
2026-03-24 16:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8653decb-a9a9-5411-a78c-fdf24fccf8f8 with identifier: 1980611
2026-03-24 16:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8 with scrape type 1
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/1.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/2.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/3.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/4.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/5.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/6.jpg not downloaded yet
2026-03-24 16:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/7.jpg not downloaded yet
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/8.jpg not downloaded yet
2026-03-24 16:45:24 [ayvens.fr] INFO: Found listing with ID: 1980612
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980612%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [ayvens.fr] INFO: Scrape type for 1980612: 1
2026-03-24 16:45:24 [ayvens.fr] INFO: Extracting data for car ID: 1980612
2026-03-24 16:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000ddbfc-ac72-5177-a02a-4767f4e54de7 with identifier: 1980612
2026-03-24 16:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000ddbfc-ac72-5177-a02a-4767f4e54de7 with scrape type 1
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/1.jpg not downloaded yet
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/2.jpg not downloaded yet
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/3.jpg not downloaded yet
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/4.jpg not downloaded yet
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/5.jpg not downloaded yet
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be3710>
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/4.jpg saved to cache
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/6.jpg not downloaded yet
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/7.jpg not downloaded yet
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/8.jpg not downloaded yet
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bcaed0>
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/6.jpg saved to cache
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0d650>
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/5.jpg saved to cache
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07290>
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/1.jpg saved to cache
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82e90>
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/2.jpg saved to cache
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:24 [ayvens.fr] INFO: Found listing with ID: 1980613
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980613%27 HTTP/1.1" 200 None
2026-03-24 16:45:24 [ayvens.fr] INFO: Scrape type for 1980613: 1
2026-03-24 16:45:24 [ayvens.fr] INFO: Extracting data for car ID: 1980613
2026-03-24 16:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c6a979-8512-5288-bca2-20ae31f46acc with identifier: 1980613
2026-03-24 16:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c6a979-8512-5288-bca2-20ae31f46acc with scrape type 1
2026-03-24 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/1.jpg not downloaded yet
2026-03-24 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/2.jpg not downloaded yet
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc6910>
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/3.jpg saved to cache
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc0a10>
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/8.jpg saved to cache
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a8210>
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/1.jpg saved to cache
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/3.jpg not downloaded yet
2026-03-24 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/4.jpg not downloaded yet
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/5.jpg not downloaded yet
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a4190>
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/4.jpg saved to cache
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf6950>
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fdbbb48df38c24139a09311e5aef598ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/7.jpg saved to cache
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dfde11e-3cae-5652-a657-5b94098ae972
2026-03-24 16:45:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dfde11e-3cae-5652-a657-5b94098ae972, skipping ID generation
2026-03-24 16:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dfde11e-3cae-5652-a657-5b94098ae972 with scrape type 1
2026-03-24 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dfde11e-3cae-5652-a657-5b94098ae972 sending to next pipeline
2026-03-24 16:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5dfde11e-3cae-5652-a657-5b94098ae972, identifier: 1980609
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82d10>
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/2.jpg saved to cache
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b73d0>
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/3.jpg saved to cache
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f2150>
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/5.jpg saved to cache
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5dfde11e-3cae-5652-a657-5b94098ae972 with identifier: 1980609
2026-03-24 16:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5dfde11e-3cae-5652-a657-5b94098ae972 with identifier: 1980609
2026-03-24 16:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5dfde11e-3cae-5652-a657-5b94098ae972 with identifier: 1980609 to the API
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '5dfde11e-3cae-5652-a657-5b94098ae972',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 17267,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285143,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dfde11e-3cae-5652-a657-5b94098ae972/5dfde11e-3cae-5652-a657-5b94098ae972_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/dbbb48df38c24139a09311e5aef598ff/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2023}
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980609%27 HTTP/1.1" 200 None
2026-03-24 16:45:26 [ayvens.fr] INFO: Saving data for 1980609: {'created_time': 1774370726.702682, 'last_price_update_time': 1774370726.702696, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980609') HTTP/1.1" 204 0
2026-03-24 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/6.jpg not downloaded yet
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/7.jpg not downloaded yet
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724ad0>
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/7.jpg saved to cache
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da7e50>
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/8.jpg saved to cache
2026-03-24 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d859d0>
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fea93495b54514e4eb24bdc0466a7199a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/6.jpg saved to cache
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32061d4a-c9f1-5b8d-9815-0827de4a160a
2026-03-24 16:45:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32061d4a-c9f1-5b8d-9815-0827de4a160a, skipping ID generation
2026-03-24 16:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32061d4a-c9f1-5b8d-9815-0827de4a160a with scrape type 1
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32061d4a-c9f1-5b8d-9815-0827de4a160a sending to next pipeline
2026-03-24 16:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 32061d4a-c9f1-5b8d-9815-0827de4a160a, identifier: 1980610
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4556210>
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/7.jpg saved to cache
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d4510>
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/6.jpg saved to cache
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7ff50>
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/8.jpg saved to cache
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/8.jpg not downloaded yet
2026-03-24 16:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 32061d4a-c9f1-5b8d-9815-0827de4a160a with identifier: 1980610
2026-03-24 16:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 32061d4a-c9f1-5b8d-9815-0827de4a160a with identifier: 1980610
2026-03-24 16:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 32061d4a-c9f1-5b8d-9815-0827de4a160a with identifier: 1980610 to the API
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '32061d4a-c9f1-5b8d-9815-0827de4a160a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 50735,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311341,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32061d4a-c9f1-5b8d-9815-0827de4a160a/32061d4a-c9f1-5b8d-9815-0827de4a160a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ea93495b54514e4eb24bdc0466a7199a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2023}
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980610%27 HTTP/1.1" 200 None
2026-03-24 16:45:27 [ayvens.fr] INFO: Saving data for 1980610: {'created_time': 1774370727.918403, 'last_price_update_time': 1774370727.918416, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980610') HTTP/1.1" 204 0
2026-03-24 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:27 [ayvens.fr] INFO: Found listing with ID: 1980614
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980614%27 HTTP/1.1" 200 None
2026-03-24 16:45:27 [ayvens.fr] INFO: Scrape type for 1980614: 1
2026-03-24 16:45:27 [ayvens.fr] INFO: Extracting data for car ID: 1980614
2026-03-24 16:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c13feeb-9470-547f-9103-ea31c54ae801 with identifier: 1980614
2026-03-24 16:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c13feeb-9470-547f-9103-ea31c54ae801 with scrape type 1
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/1.jpg not downloaded yet
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79f9710>
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/1.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f3d0>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/2.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/2.jpg not downloaded yet
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69ad0>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/4.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/3.jpg not downloaded yet
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60abe50>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/5.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457e190>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/3.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5deda10>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/7.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/4.jpg not downloaded yet
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/5.jpg not downloaded yet
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d9a810>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/4.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666c1d0>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/8.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08050>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F5528d43cefa94c83889a8e7954451c13%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/6.jpg saved to cache
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 000ddbfc-ac72-5177-a02a-4767f4e54de7
2026-03-24 16:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 000ddbfc-ac72-5177-a02a-4767f4e54de7, skipping ID generation
2026-03-24 16:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000ddbfc-ac72-5177-a02a-4767f4e54de7 with scrape type 1
2026-03-24 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 000ddbfc-ac72-5177-a02a-4767f4e54de7 sending to next pipeline
2026-03-24 16:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 000ddbfc-ac72-5177-a02a-4767f4e54de7, identifier: 1980612
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c720d0>
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/5.jpg saved to cache
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 000ddbfc-ac72-5177-a02a-4767f4e54de7 with identifier: 1980612
2026-03-24 16:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 000ddbfc-ac72-5177-a02a-4767f4e54de7 with identifier: 1980612
2026-03-24 16:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 000ddbfc-ac72-5177-a02a-4767f4e54de7 with identifier: 1980612 to the API
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '000ddbfc-ac72-5177-a02a-4767f4e54de7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 14869,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000ddbfc-ac72-5177-a02a-4767f4e54de7/000ddbfc-ac72-5177-a02a-4767f4e54de7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/5528d43cefa94c83889a8e7954451c13/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2024}
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980612%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [ayvens.fr] INFO: Saving data for 1980612: {'created_time': 1774370729.445923, 'last_price_update_time': 1774370729.445941, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980612') HTTP/1.1" 204 0
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/6.jpg not downloaded yet
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/7.jpg not downloaded yet
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/8.jpg not downloaded yet
2026-03-24 16:45:29 [ayvens.fr] INFO: Found listing with ID: 1980615
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980615%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [ayvens.fr] INFO: Scrape type for 1980615: 1
2026-03-24 16:45:29 [ayvens.fr] INFO: Extracting data for car ID: 1980615
2026-03-24 16:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889eced7-bfe7-5730-975e-41bed8d6b10b with identifier: 1980615
2026-03-24 16:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889eced7-bfe7-5730-975e-41bed8d6b10b with scrape type 1
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/1.jpg not downloaded yet
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/2.jpg not downloaded yet
2026-03-24 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/3.jpg not downloaded yet
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b9910>
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/2.jpg saved to cache
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570fc90>
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/3.jpg saved to cache
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be1090>
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/4.jpg saved to cache
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f3810>
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/2.jpg saved to cache
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/4.jpg not downloaded yet
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def410>
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/5.jpg saved to cache
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/5.jpg not downloaded yet
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/6.jpg not downloaded yet
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c837d0>
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/1.jpg saved to cache
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4290>
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/3.jpg saved to cache
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7eded50>
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F386c5d318fe64e01b2da80edfaf115ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/1.jpg saved to cache
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8
2026-03-24 16:45:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8653decb-a9a9-5411-a78c-fdf24fccf8f8, skipping ID generation
2026-03-24 16:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8 with scrape type 1
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8653decb-a9a9-5411-a78c-fdf24fccf8f8 sending to next pipeline
2026-03-24 16:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8653decb-a9a9-5411-a78c-fdf24fccf8f8, identifier: 1980611
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d32250>
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/7.jpg saved to cache
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8653decb-a9a9-5411-a78c-fdf24fccf8f8 with identifier: 1980611
2026-03-24 16:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8653decb-a9a9-5411-a78c-fdf24fccf8f8 with identifier: 1980611
2026-03-24 16:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8653decb-a9a9-5411-a78c-fdf24fccf8f8 with identifier: 1980611 to the API
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '8653decb-a9a9-5411-a78c-fdf24fccf8f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 49631,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8653decb-a9a9-5411-a78c-fdf24fccf8f8/8653decb-a9a9-5411-a78c-fdf24fccf8f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/386c5d318fe64e01b2da80edfaf115ad/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2023}
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980611%27 HTTP/1.1" 200 None
2026-03-24 16:45:30 [ayvens.fr] INFO: Saving data for 1980611: {'created_time': 1774370730.834097, 'last_price_update_time': 1774370730.83411, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980611') HTTP/1.1" 204 0
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/7.jpg not downloaded yet
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/8.jpg not downloaded yet
2026-03-24 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33790>
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/6.jpg saved to cache
2026-03-24 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4dcd0>
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/5.jpg saved to cache
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09a90>
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/4.jpg saved to cache
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1f0d0>
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc79af3428a384384808695cb386ef88a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/8.jpg saved to cache
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92c6a979-8512-5288-bca2-20ae31f46acc
2026-03-24 16:45:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92c6a979-8512-5288-bca2-20ae31f46acc, skipping ID generation
2026-03-24 16:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c6a979-8512-5288-bca2-20ae31f46acc with scrape type 1
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92c6a979-8512-5288-bca2-20ae31f46acc sending to next pipeline
2026-03-24 16:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 92c6a979-8512-5288-bca2-20ae31f46acc, identifier: 1980613
2026-03-24 16:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:31 [ayvens.fr] INFO: Found listing with ID: 1980616
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980616%27 HTTP/1.1" 200 None
2026-03-24 16:45:31 [ayvens.fr] INFO: Scrape type for 1980616: 1
2026-03-24 16:45:31 [ayvens.fr] INFO: Extracting data for car ID: 1980616
2026-03-24 16:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8295703-71e0-5ef5-a680-b538461d4a15 with identifier: 1980616
2026-03-24 16:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8295703-71e0-5ef5-a680-b538461d4a15 with scrape type 1
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/1.jpg not downloaded yet
2026-03-24 16:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 92c6a979-8512-5288-bca2-20ae31f46acc with identifier: 1980613
2026-03-24 16:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 92c6a979-8512-5288-bca2-20ae31f46acc with identifier: 1980613
2026-03-24 16:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 92c6a979-8512-5288-bca2-20ae31f46acc with identifier: 1980613 to the API
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '92c6a979-8512-5288-bca2-20ae31f46acc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 33869,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c6a979-8512-5288-bca2-20ae31f46acc/92c6a979-8512-5288-bca2-20ae31f46acc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c79af3428a384384808695cb386ef88a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2024}
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980613%27 HTTP/1.1" 200 None
2026-03-24 16:45:31 [ayvens.fr] INFO: Saving data for 1980613: {'created_time': 1774370731.774412, 'last_price_update_time': 1774370731.774425, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980613') HTTP/1.1" 204 0
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/2.jpg not downloaded yet
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09f50>
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/6.jpg saved to cache
2026-03-24 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b6c10>
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/2.jpg saved to cache
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c63490>
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/3.jpg saved to cache
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3a290>
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/1.jpg saved to cache
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c0fd0>
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/7.jpg saved to cache
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/3.jpg not downloaded yet
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33d90>
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb36dd9c9cf8841349b773eb1f66e91ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/8.jpg saved to cache
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c13feeb-9470-547f-9103-ea31c54ae801
2026-03-24 16:45:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c13feeb-9470-547f-9103-ea31c54ae801, skipping ID generation
2026-03-24 16:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c13feeb-9470-547f-9103-ea31c54ae801 with scrape type 1
2026-03-24 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c13feeb-9470-547f-9103-ea31c54ae801 sending to next pipeline
2026-03-24 16:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8c13feeb-9470-547f-9103-ea31c54ae801, identifier: 1980614
2026-03-24 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8c13feeb-9470-547f-9103-ea31c54ae801 with identifier: 1980614
2026-03-24 16:45:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8c13feeb-9470-547f-9103-ea31c54ae801 with identifier: 1980614
2026-03-24 16:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8c13feeb-9470-547f-9103-ea31c54ae801 with identifier: 1980614 to the API
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'BOSSA NOVA WHITE',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8c13feeb-9470-547f-9103-ea31c54ae801',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 12071,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481350,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481350,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13feeb-9470-547f-9103-ea31c54ae801/8c13feeb-9470-547f-9103-ea31c54ae801_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b36dd9c9cf8841349b773eb1f66e91ca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-11',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980614%27 HTTP/1.1" 200 None
2026-03-24 16:45:32 [ayvens.fr] INFO: Saving data for 1980614: {'created_time': 1774370732.97935, 'last_price_update_time': 1774370732.979363, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980614') HTTP/1.1" 204 0
2026-03-24 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/4.jpg not downloaded yet
2026-03-24 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/5.jpg not downloaded yet
2026-03-24 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79e3410>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/4.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/6.jpg not downloaded yet
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/7.jpg not downloaded yet
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a8d50>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/3.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459acd0>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/1.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d02b10>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/2.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3bc90>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/6.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4c890>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/5.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d03910>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/7.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/8.jpg not downloaded yet
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dc9c50>
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F0f3b7f163f484b9db7f02a98869b0e35%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/8.jpg saved to cache
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 889eced7-bfe7-5730-975e-41bed8d6b10b
2026-03-24 16:45:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 889eced7-bfe7-5730-975e-41bed8d6b10b, skipping ID generation
2026-03-24 16:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889eced7-bfe7-5730-975e-41bed8d6b10b with scrape type 1
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 889eced7-bfe7-5730-975e-41bed8d6b10b sending to next pipeline
2026-03-24 16:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 889eced7-bfe7-5730-975e-41bed8d6b10b, identifier: 1980615
2026-03-24 16:45:33 [ayvens.fr] INFO: Found listing with ID: 1980617
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980617%27 HTTP/1.1" 200 None
2026-03-24 16:45:33 [ayvens.fr] INFO: Scrape type for 1980617: 1
2026-03-24 16:45:33 [ayvens.fr] INFO: Extracting data for car ID: 1980617
2026-03-24 16:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86849338-1b72-5d7f-9c7f-25a8d2c346ba with identifier: 1980617
2026-03-24 16:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba with scrape type 1
2026-03-24 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/1.jpg not downloaded yet
2026-03-24 16:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 889eced7-bfe7-5730-975e-41bed8d6b10b with identifier: 1980615
2026-03-24 16:45:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 889eced7-bfe7-5730-975e-41bed8d6b10b with identifier: 1980615
2026-03-24 16:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 889eced7-bfe7-5730-975e-41bed8d6b10b with identifier: 1980615 to the API
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '889eced7-bfe7-5730-975e-41bed8d6b10b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 96483,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296969,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889eced7-bfe7-5730-975e-41bed8d6b10b/889eced7-bfe7-5730-975e-41bed8d6b10b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/0f3b7f163f484b9db7f02a98869b0e35/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 220ch Equilibre '
'optimum charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 220ch Equilibre optimum charge',
'vin': None,
'year': 2022}
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980615%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [ayvens.fr] INFO: Saving data for 1980615: {'created_time': 1774370734.428667, 'last_price_update_time': 1774370734.42868, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980615') HTTP/1.1" 204 0
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/2.jpg not downloaded yet
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/3.jpg not downloaded yet
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/4.jpg not downloaded yet
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/5.jpg not downloaded yet
2026-03-24 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/6.jpg not downloaded yet
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a07f50>
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/2.jpg saved to cache
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/7.jpg not downloaded yet
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc17d0>
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/3.jpg saved to cache
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a7010>
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/4.jpg saved to cache
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddf710>
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/5.jpg saved to cache
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/8.jpg not downloaded yet
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726150>
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/1.jpg saved to cache
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc5710>
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/6.jpg saved to cache
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad550>
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/7.jpg saved to cache
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [ayvens.fr] INFO: Found listing with ID: 1980618
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980618%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [ayvens.fr] INFO: Scrape type for 1980618: 1
2026-03-24 16:45:35 [ayvens.fr] INFO: Extracting data for car ID: 1980618
2026-03-24 16:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a258dd-d9db-5c18-97fc-75a82e1fe218 with identifier: 1980618
2026-03-24 16:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a258dd-d9db-5c18-97fc-75a82e1fe218 with scrape type 1
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/1.jpg not downloaded yet
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/2.jpg not downloaded yet
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/3.jpg not downloaded yet
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/4.jpg not downloaded yet
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/5.jpg not downloaded yet
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f4150>
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8bc6d741d0aa4b7ebe6d27e276b41ea9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/8.jpg saved to cache
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8295703-71e0-5ef5-a680-b538461d4a15
2026-03-24 16:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8295703-71e0-5ef5-a680-b538461d4a15, skipping ID generation
2026-03-24 16:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8295703-71e0-5ef5-a680-b538461d4a15 with scrape type 1
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8295703-71e0-5ef5-a680-b538461d4a15 sending to next pipeline
2026-03-24 16:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f8295703-71e0-5ef5-a680-b538461d4a15, identifier: 1980616
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/6.jpg not downloaded yet
2026-03-24 16:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f8295703-71e0-5ef5-a680-b538461d4a15 with identifier: 1980616
2026-03-24 16:45:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f8295703-71e0-5ef5-a680-b538461d4a15 with identifier: 1980616
2026-03-24 16:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f8295703-71e0-5ef5-a680-b538461d4a15 with identifier: 1980616 to the API
2026-03-24 16:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'f8295703-71e0-5ef5-a680-b538461d4a15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 127724,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8295703-71e0-5ef5-a680-b538461d4a15/f8295703-71e0-5ef5-a680-b538461d4a15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8bc6d741d0aa4b7ebe6d27e276b41ea9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980616%27 HTTP/1.1" 200 None
2026-03-24 16:45:36 [ayvens.fr] INFO: Saving data for 1980616: {'created_time': 1774370736.620123, 'last_price_update_time': 1774370736.620142, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980616') HTTP/1.1" 204 0
2026-03-24 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/7.jpg not downloaded yet
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1cf50>
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/2.jpg saved to cache
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfa090>
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/1.jpg saved to cache
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be1010>
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/5.jpg saved to cache
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf0790>
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/3.jpg saved to cache
2026-03-24 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d72050>
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/4.jpg saved to cache
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1fa90>
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/6.jpg saved to cache
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/8.jpg not downloaded yet
2026-03-24 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:37 [ayvens.fr] INFO: Found listing with ID: 1980619
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980619%27 HTTP/1.1" 200 None
2026-03-24 16:45:37 [ayvens.fr] INFO: Scrape type for 1980619: 1
2026-03-24 16:45:37 [ayvens.fr] INFO: Extracting data for car ID: 1980619
2026-03-24 16:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc0684a-86e8-527b-8cda-d9df52d7d361 with identifier: 1980619
2026-03-24 16:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc0684a-86e8-527b-8cda-d9df52d7d361 with scrape type 1
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/1.jpg not downloaded yet
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c1190>
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/7.jpg saved to cache
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/2.jpg not downloaded yet
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c0a90>
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F24815b28c69b4c618c5b57249692696d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/8.jpg saved to cache
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba
2026-03-24 16:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86849338-1b72-5d7f-9c7f-25a8d2c346ba, skipping ID generation
2026-03-24 16:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba with scrape type 1
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86849338-1b72-5d7f-9c7f-25a8d2c346ba sending to next pipeline
2026-03-24 16:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 86849338-1b72-5d7f-9c7f-25a8d2c346ba, identifier: 1980617
2026-03-24 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/3.jpg not downloaded yet
2026-03-24 16:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 86849338-1b72-5d7f-9c7f-25a8d2c346ba with identifier: 1980617
2026-03-24 16:45:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 86849338-1b72-5d7f-9c7f-25a8d2c346ba with identifier: 1980617
2026-03-24 16:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 86849338-1b72-5d7f-9c7f-25a8d2c346ba with identifier: 1980617 to the API
2026-03-24 16:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '86849338-1b72-5d7f-9c7f-25a8d2c346ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 104175,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86849338-1b72-5d7f-9c7f-25a8d2c346ba/86849338-1b72-5d7f-9c7f-25a8d2c346ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/24815b28c69b4c618c5b57249692696d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T4 Recharge 129 + 82ch Start DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T4 Recharge 129 + 82ch Start DCT 7',
'vin': None,
'year': 2023}
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980617%27 HTTP/1.1" 200 None
2026-03-24 16:45:38 [ayvens.fr] INFO: Saving data for 1980617: {'created_time': 1774370738.532413, 'last_price_update_time': 1774370738.532426, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980617') HTTP/1.1" 204 0
2026-03-24 16:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/4.jpg not downloaded yet
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bca010>
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/3.jpg saved to cache
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c56850>
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/1.jpg saved to cache
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459cb90>
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/2.jpg saved to cache
2026-03-24 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b57710>
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/5.jpg saved to cache
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61550>
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/4.jpg saved to cache
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/5.jpg not downloaded yet
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/6.jpg not downloaded yet
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddea90>
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/7.jpg saved to cache
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5650>
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/6.jpg saved to cache
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/7.jpg not downloaded yet
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19cd0>
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b57ebe2a0bd49dab84aa3ccc91d1b09%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/8.jpg saved to cache
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3a258dd-d9db-5c18-97fc-75a82e1fe218
2026-03-24 16:45:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3a258dd-d9db-5c18-97fc-75a82e1fe218, skipping ID generation
2026-03-24 16:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a258dd-d9db-5c18-97fc-75a82e1fe218 with scrape type 1
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3a258dd-d9db-5c18-97fc-75a82e1fe218 sending to next pipeline
2026-03-24 16:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a3a258dd-d9db-5c18-97fc-75a82e1fe218, identifier: 1980618
2026-03-24 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/8.jpg not downloaded yet
2026-03-24 16:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a3a258dd-d9db-5c18-97fc-75a82e1fe218 with identifier: 1980618
2026-03-24 16:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a3a258dd-d9db-5c18-97fc-75a82e1fe218 with identifier: 1980618
2026-03-24 16:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a3a258dd-d9db-5c18-97fc-75a82e1fe218 with identifier: 1980618 to the API
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 23,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'a3a258dd-d9db-5c18-97fc-75a82e1fe218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 59872,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a258dd-d9db-5c18-97fc-75a82e1fe218/a3a258dd-d9db-5c18-97fc-75a82e1fe218_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b57ebe2a0bd49dab84aa3ccc91d1b09/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Utimate Style Dark Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Utimate Style Dark Geartronic',
'vin': None,
'year': 2023}
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980618%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [ayvens.fr] INFO: Saving data for 1980618: {'created_time': 1774370739.88976, 'last_price_update_time': 1774370739.889773, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980618') HTTP/1.1" 204 0
2026-03-24 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:39 [ayvens.fr] INFO: Found listing with ID: 1980620
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980620%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [ayvens.fr] INFO: Scrape type for 1980620: 1
2026-03-24 16:45:39 [ayvens.fr] INFO: Extracting data for car ID: 1980620
2026-03-24 16:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae39abe-8fcf-5237-93be-276ed5b856ca with identifier: 1980620
2026-03-24 16:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae39abe-8fcf-5237-93be-276ed5b856ca with scrape type 1
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/1.jpg not downloaded yet
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81550>
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/1.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d61790>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/2.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/2.jpg not downloaded yet
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/3.jpg not downloaded yet
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718290>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/3.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cea010>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/4.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/4.jpg not downloaded yet
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c05190>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/5.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/5.jpg not downloaded yet
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfec90>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/7.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/6.jpg not downloaded yet
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff310>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/6.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/7.jpg not downloaded yet
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/8.jpg not downloaded yet
2026-03-24 16:45:40 [ayvens.fr] INFO: Found listing with ID: 1980621
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980621%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [ayvens.fr] INFO: Scrape type for 1980621: 1
2026-03-24 16:45:40 [ayvens.fr] INFO: Extracting data for car ID: 1980621
2026-03-24 16:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc with identifier: 1980621
2026-03-24 16:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc with scrape type 1
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/1.jpg not downloaded yet
2026-03-24 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/2.jpg not downloaded yet
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bea50>
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F20d4305a74e54398b83f4a0fb042c655%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/8.jpg saved to cache
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcc0684a-86e8-527b-8cda-d9df52d7d361
2026-03-24 16:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcc0684a-86e8-527b-8cda-d9df52d7d361, skipping ID generation
2026-03-24 16:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc0684a-86e8-527b-8cda-d9df52d7d361 with scrape type 1
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcc0684a-86e8-527b-8cda-d9df52d7d361 sending to next pipeline
2026-03-24 16:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dcc0684a-86e8-527b-8cda-d9df52d7d361, identifier: 1980619
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/3.jpg not downloaded yet
2026-03-24 16:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dcc0684a-86e8-527b-8cda-d9df52d7d361 with identifier: 1980619
2026-03-24 16:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dcc0684a-86e8-527b-8cda-d9df52d7d361 with identifier: 1980619
2026-03-24 16:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dcc0684a-86e8-527b-8cda-d9df52d7d361 with identifier: 1980619 to the API
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'dcc0684a-86e8-527b-8cda-d9df52d7d361',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 78263,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcc0684a-86e8-527b-8cda-d9df52d7d361/dcc0684a-86e8-527b-8cda-d9df52d7d361_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411483,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/20d4305a74e54398b83f4a0fb042c655/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T4 Recharge 129 + 82ch Start DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T4 Recharge 129 + 82ch Start DCT 7',
'vin': None,
'year': 2022}
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980619%27 HTTP/1.1" 200 None
2026-03-24 16:45:41 [ayvens.fr] INFO: Saving data for 1980619: {'created_time': 1774370741.422797, 'last_price_update_time': 1774370741.42281, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980619') HTTP/1.1" 204 0
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e39490>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/1.jpg saved to cache
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/4.jpg not downloaded yet
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a4210>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/2.jpg saved to cache
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2650>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/3.jpg saved to cache
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/5.jpg not downloaded yet
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e883da90>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/7.jpg saved to cache
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/6.jpg not downloaded yet
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb6d0>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/4.jpg saved to cache
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/7.jpg not downloaded yet
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/8.jpg not downloaded yet
2026-03-24 16:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666ff10>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/5.jpg saved to cache
2026-03-24 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a4f90>
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/6.jpg saved to cache
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:42 [ayvens.fr] INFO: Found listing with ID: 1980622
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980622%27 HTTP/1.1" 200 None
2026-03-24 16:45:42 [ayvens.fr] INFO: Scrape type for 1980622: 1
2026-03-24 16:45:42 [ayvens.fr] INFO: Extracting data for car ID: 1980622
2026-03-24 16:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e176f5-b46a-548a-bc58-a9e715bf933c with identifier: 1980622
2026-03-24 16:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e176f5-b46a-548a-bc58-a9e715bf933c with scrape type 1
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/1.jpg not downloaded yet
2026-03-24 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/2.jpg not downloaded yet
2026-03-24 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81190>
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F29c27cbd9ab74ff5bb3a76fe025c00af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/8.jpg saved to cache
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ae39abe-8fcf-5237-93be-276ed5b856ca
2026-03-24 16:45:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ae39abe-8fcf-5237-93be-276ed5b856ca, skipping ID generation
2026-03-24 16:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae39abe-8fcf-5237-93be-276ed5b856ca with scrape type 1
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ae39abe-8fcf-5237-93be-276ed5b856ca sending to next pipeline
2026-03-24 16:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1ae39abe-8fcf-5237-93be-276ed5b856ca, identifier: 1980620
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d51890>
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/1.jpg saved to cache
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb550>
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/2.jpg saved to cache
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/3.jpg not downloaded yet
2026-03-24 16:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1ae39abe-8fcf-5237-93be-276ed5b856ca with identifier: 1980620
2026-03-24 16:45:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1ae39abe-8fcf-5237-93be-276ed5b856ca with identifier: 1980620
2026-03-24 16:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1ae39abe-8fcf-5237-93be-276ed5b856ca with identifier: 1980620 to the API
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '1ae39abe-8fcf-5237-93be-276ed5b856ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 16457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae39abe-8fcf-5237-93be-276ed5b856ca/1ae39abe-8fcf-5237-93be-276ed5b856ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/29c27cbd9ab74ff5bb3a76fe025c00af/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance',
'vin': None,
'year': 2023}
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980620%27 HTTP/1.1" 200 None
2026-03-24 16:45:42 [ayvens.fr] INFO: Saving data for 1980620: {'created_time': 1774370742.875301, 'last_price_update_time': 1774370742.875313, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980620') HTTP/1.1" 204 0
2026-03-24 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/4.jpg not downloaded yet
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45754d0>
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/3.jpg saved to cache
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19210>
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/4.jpg saved to cache
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/5.jpg not downloaded yet
2026-03-24 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/6.jpg not downloaded yet
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454ea90>
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/5.jpg saved to cache
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/7.jpg not downloaded yet
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/8.jpg not downloaded yet
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45be610>
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/6.jpg saved to cache
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571a790>
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/8.jpg saved to cache
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cbaa10>
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F17eae01d0be34e2db08b3921158ca7a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/7.jpg saved to cache
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc
2026-03-24 16:45:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc, skipping ID generation
2026-03-24 16:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc with scrape type 1
2026-03-24 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc sending to next pipeline
2026-03-24 16:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc, identifier: 1980621
2026-03-24 16:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc with identifier: 1980621
2026-03-24 16:45:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc with identifier: 1980621
2026-03-24 16:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc with identifier: 1980621 to the API
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'NOIR KARBON',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 107875,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc/f73f1e6f-eb0a-54a6-9ef0-0674a22c7ddc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/17eae01d0be34e2db08b3921158ca7a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance',
'vin': None,
'year': 2023}
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980621%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [ayvens.fr] INFO: Saving data for 1980621: {'created_time': 1774370744.064257, 'last_price_update_time': 1774370744.06427, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980621') HTTP/1.1" 204 0
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [ayvens.fr] INFO: Found listing with ID: 1980623
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980623%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [ayvens.fr] INFO: Scrape type for 1980623: 1
2026-03-24 16:45:44 [ayvens.fr] INFO: Extracting data for car ID: 1980623
2026-03-24 16:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7da0510-6487-5922-936a-514c28283ceb with identifier: 1980623
2026-03-24 16:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7da0510-6487-5922-936a-514c28283ceb with scrape type 1
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/1.jpg not downloaded yet
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4d390>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/1.jpg saved to cache
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/2.jpg not downloaded yet
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/3.jpg not downloaded yet
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a910>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/2.jpg saved to cache
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/4.jpg not downloaded yet
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f59d0>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/4.jpg saved to cache
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82ed0>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/3.jpg saved to cache
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c54910>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/6.jpg saved to cache
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0750>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/5.jpg saved to cache
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/5.jpg not downloaded yet
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/6.jpg not downloaded yet
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/7.jpg not downloaded yet
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/8.jpg not downloaded yet
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:44 [ayvens.fr] INFO: Found listing with ID: 1980624
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980624%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [ayvens.fr] INFO: Scrape type for 1980624: 1
2026-03-24 16:45:44 [ayvens.fr] INFO: Extracting data for car ID: 1980624
2026-03-24 16:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 with identifier: 1980624
2026-03-24 16:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 with scrape type 1
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/1.jpg not downloaded yet
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/2.jpg not downloaded yet
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2590>
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/7.jpg saved to cache
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/3.jpg not downloaded yet
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/4.jpg not downloaded yet
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/5.jpg not downloaded yet
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd46d0>
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/1.jpg saved to cache
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c70210>
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F8b60ec0bed6243ecb3de08271d89d783%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/8.jpg saved to cache
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95e176f5-b46a-548a-bc58-a9e715bf933c
2026-03-24 16:45:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95e176f5-b46a-548a-bc58-a9e715bf933c, skipping ID generation
2026-03-24 16:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e176f5-b46a-548a-bc58-a9e715bf933c with scrape type 1
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95e176f5-b46a-548a-bc58-a9e715bf933c sending to next pipeline
2026-03-24 16:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 95e176f5-b46a-548a-bc58-a9e715bf933c, identifier: 1980622
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56bff10>
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/2.jpg saved to cache
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 95e176f5-b46a-548a-bc58-a9e715bf933c with identifier: 1980622
2026-03-24 16:45:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 95e176f5-b46a-548a-bc58-a9e715bf933c with identifier: 1980622
2026-03-24 16:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 95e176f5-b46a-548a-bc58-a9e715bf933c with identifier: 1980622 to the API
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'GRIS PLATINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '95e176f5-b46a-548a-bc58-a9e715bf933c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 38342,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295246,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e176f5-b46a-548a-bc58-a9e715bf933c/95e176f5-b46a-548a-bc58-a9e715bf933c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/8b60ec0bed6243ecb3de08271d89d783/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN MICRA Micra 1.0 IG-T 92ch Business Edition',
'transmission': 'manual',
'trim': 'Micra 1.0 IG-T 92ch Business Edition',
'vin': None,
'year': 2021}
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980622%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [ayvens.fr] INFO: Saving data for 1980622: {'created_time': 1774370745.759367, 'last_price_update_time': 1774370745.759377, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980622') HTTP/1.1" 204 0
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/6.jpg not downloaded yet
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/7.jpg not downloaded yet
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf8290>
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/4.jpg saved to cache
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7ba50>
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/7.jpg saved to cache
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/8.jpg not downloaded yet
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:45 [ayvens.fr] INFO: Found listing with ID: 1980625
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980625%27 HTTP/1.1" 200 None
2026-03-24 16:45:45 [ayvens.fr] INFO: Scrape type for 1980625: 1
2026-03-24 16:45:45 [ayvens.fr] INFO: Extracting data for car ID: 1980625
2026-03-24 16:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d95ac52-8af6-5d53-8e24-54afc97c5699 with identifier: 1980625
2026-03-24 16:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d95ac52-8af6-5d53-8e24-54afc97c5699 with scrape type 1
2026-03-24 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/1.jpg not downloaded yet
2026-03-24 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e05d50>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/3.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5d10>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/8.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd4c50>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/5.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/2.jpg not downloaded yet
2026-03-24 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/3.jpg not downloaded yet
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c716d0>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6ddc8570809d4ca4a419efd1927ec756%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/6.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7da0510-6487-5922-936a-514c28283ceb
2026-03-24 16:45:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7da0510-6487-5922-936a-514c28283ceb, skipping ID generation
2026-03-24 16:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7da0510-6487-5922-936a-514c28283ceb with scrape type 1
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7da0510-6487-5922-936a-514c28283ceb sending to next pipeline
2026-03-24 16:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d7da0510-6487-5922-936a-514c28283ceb, identifier: 1980623
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4c90>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/1.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60990>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/2.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f3750>
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/3.jpg saved to cache
2026-03-24 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d7da0510-6487-5922-936a-514c28283ceb with identifier: 1980623
2026-03-24 16:45:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d7da0510-6487-5922-936a-514c28283ceb with identifier: 1980623
2026-03-24 16:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d7da0510-6487-5922-936a-514c28283ceb with identifier: 1980623 to the API
2026-03-24 16:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'BLEU CELEBS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'd7da0510-6487-5922-936a-514c28283ceb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 108749,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7da0510-6487-5922-936a-514c28283ceb/d7da0510-6487-5922-936a-514c28283ceb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6ddc8570809d4ca4a419efd1927ec756/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980623%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [ayvens.fr] INFO: Saving data for 1980623: {'created_time': 1774370747.157764, 'last_price_update_time': 1774370747.157775, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980623') HTTP/1.1" 204 0
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/4.jpg not downloaded yet
2026-03-24 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e110>
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/4.jpg saved to cache
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/5.jpg not downloaded yet
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e39b50>
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/5.jpg saved to cache
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/6.jpg not downloaded yet
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f5510>
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/7.jpg saved to cache
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/7.jpg not downloaded yet
2026-03-24 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b63350>
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/6.jpg saved to cache
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/8.jpg not downloaded yet
2026-03-24 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:47 [ayvens.fr] INFO: Found listing with ID: 1980626
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980626%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [ayvens.fr] INFO: Scrape type for 1980626: 1
2026-03-24 16:45:47 [ayvens.fr] INFO: Extracting data for car ID: 1980626
2026-03-24 16:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0450e88-919b-5fa8-be05-225bba7b3e19 with identifier: 1980626
2026-03-24 16:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0450e88-919b-5fa8-be05-225bba7b3e19 with scrape type 1
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/1.jpg not downloaded yet
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b614d0>
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F31ba40981b164d9fa1dab59ef553341c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/8.jpg saved to cache
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2
2026-03-24 16:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 630fb0a4-2dc1-5cf7-8f20-31363a1947b2, skipping ID generation
2026-03-24 16:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 with scrape type 1
2026-03-24 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 sending to next pipeline
2026-03-24 16:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 630fb0a4-2dc1-5cf7-8f20-31363a1947b2, identifier: 1980624
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4e0d0>
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/1.jpg saved to cache
2026-03-24 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 with identifier: 1980624
2026-03-24 16:45:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 with identifier: 1980624
2026-03-24 16:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 630fb0a4-2dc1-5cf7-8f20-31363a1947b2 with identifier: 1980624 to the API
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '630fb0a4-2dc1-5cf7-8f20-31363a1947b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 110690,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267323,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630fb0a4-2dc1-5cf7-8f20-31363a1947b2/630fb0a4-2dc1-5cf7-8f20-31363a1947b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/31ba40981b164d9fa1dab59ef553341c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-26',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980624%27 HTTP/1.1" 200 None
2026-03-24 16:45:48 [ayvens.fr] INFO: Saving data for 1980624: {'created_time': 1774370748.879182, 'last_price_update_time': 1774370748.879193, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980624') HTTP/1.1" 204 0
2026-03-24 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/2.jpg not downloaded yet
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454f5d0>
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/2.jpg saved to cache
2026-03-24 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/3.jpg not downloaded yet
2026-03-24 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5715bd0>
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/4.jpg saved to cache
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/4.jpg not downloaded yet
2026-03-24 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c556d0>
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/3.jpg saved to cache
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/5.jpg not downloaded yet
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/6.jpg not downloaded yet
2026-03-24 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d50a90>
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/5.jpg saved to cache
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3bd50>
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/7.jpg saved to cache
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/7.jpg not downloaded yet
2026-03-24 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/8.jpg not downloaded yet
2026-03-24 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ce50>
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/6.jpg saved to cache
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c54ed0>
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F80760cdbdbba43ad8fa7049a7a82f806%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/8.jpg saved to cache
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d95ac52-8af6-5d53-8e24-54afc97c5699
2026-03-24 16:45:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d95ac52-8af6-5d53-8e24-54afc97c5699, skipping ID generation
2026-03-24 16:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d95ac52-8af6-5d53-8e24-54afc97c5699 with scrape type 1
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d95ac52-8af6-5d53-8e24-54afc97c5699 sending to next pipeline
2026-03-24 16:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2d95ac52-8af6-5d53-8e24-54afc97c5699, identifier: 1980625
2026-03-24 16:45:49 [ayvens.fr] INFO: Found listing with ID: 1980627
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980627%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [ayvens.fr] INFO: Scrape type for 1980627: 1
2026-03-24 16:45:49 [ayvens.fr] INFO: Extracting data for car ID: 1980627
2026-03-24 16:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9d4b692-6866-5483-ad79-bd73fe5da92e with identifier: 1980627
2026-03-24 16:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d4b692-6866-5483-ad79-bd73fe5da92e with scrape type 1
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/1.jpg not downloaded yet
2026-03-24 16:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2d95ac52-8af6-5d53-8e24-54afc97c5699 with identifier: 1980625
2026-03-24 16:45:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2d95ac52-8af6-5d53-8e24-54afc97c5699 with identifier: 1980625
2026-03-24 16:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2d95ac52-8af6-5d53-8e24-54afc97c5699 with identifier: 1980625 to the API
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'BLANCHE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '2d95ac52-8af6-5d53-8e24-54afc97c5699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 120091,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377969,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d95ac52-8af6-5d53-8e24-54afc97c5699/2d95ac52-8af6-5d53-8e24-54afc97c5699_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300041,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/80760cdbdbba43ad8fa7049a7a82f806/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-16',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.6 E-Tech full hybrid 145 Evolution',
'transmission': 'automatic',
'trim': 'Clio Réversible 1.6 E-Tech full hybrid 145 Evolution',
'vin': None,
'year': 2022}
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980625%27 HTTP/1.1" 200 None
2026-03-24 16:45:50 [ayvens.fr] INFO: Saving data for 1980625: {'created_time': 1774370750.356166, 'last_price_update_time': 1774370750.356177, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980625') HTTP/1.1" 204 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/2.jpg not downloaded yet
2026-03-24 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d4b90>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/1.jpg saved to cache
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79e3f50>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/2.jpg saved to cache
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/3.jpg not downloaded yet
2026-03-24 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/4.jpg not downloaded yet
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3a850>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/3.jpg saved to cache
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f7a90>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/4.jpg saved to cache
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/5.jpg not downloaded yet
2026-03-24 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/6.jpg not downloaded yet
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb290>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/5.jpg saved to cache
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79f97d0>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/6.jpg saved to cache
2026-03-24 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2650>
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/7.jpg saved to cache
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/7.jpg not downloaded yet
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/8.jpg not downloaded yet
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5f50>
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fe63ff74ae0be4b488a4302ffa209b757%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/8.jpg saved to cache
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0450e88-919b-5fa8-be05-225bba7b3e19
2026-03-24 16:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0450e88-919b-5fa8-be05-225bba7b3e19, skipping ID generation
2026-03-24 16:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0450e88-919b-5fa8-be05-225bba7b3e19 with scrape type 1
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0450e88-919b-5fa8-be05-225bba7b3e19 sending to next pipeline
2026-03-24 16:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c0450e88-919b-5fa8-be05-225bba7b3e19, identifier: 1980626
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [ayvens.fr] INFO: Found listing with ID: 1980628
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980628%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [ayvens.fr] INFO: Scrape type for 1980628: 1
2026-03-24 16:45:51 [ayvens.fr] INFO: Extracting data for car ID: 1980628
2026-03-24 16:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f833bb3e-f543-542a-81cc-be1099fafad1 with identifier: 1980628
2026-03-24 16:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f833bb3e-f543-542a-81cc-be1099fafad1 with scrape type 1
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/1.jpg not downloaded yet
2026-03-24 16:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c0450e88-919b-5fa8-be05-225bba7b3e19 with identifier: 1980626
2026-03-24 16:45:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c0450e88-919b-5fa8-be05-225bba7b3e19 with identifier: 1980626
2026-03-24 16:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c0450e88-919b-5fa8-be05-225bba7b3e19 with identifier: 1980626 to the API
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 35,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c0450e88-919b-5fa8-be05-225bba7b3e19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS7',
'odometer': 61480,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416898,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0450e88-919b-5fa8-be05-225bba7b3e19/c0450e88-919b-5fa8-be05-225bba7b3e19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/e63ff74ae0be4b488a4302ffa209b757/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS7 DS 7 Crossback E-TENSE 4x4 300ch Performance '
'Line +',
'transmission': 'automatic',
'trim': 'DS 7 Crossback E-TENSE 4x4 300ch Performance Line +',
'vin': None,
'year': 2021}
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980626%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [ayvens.fr] INFO: Saving data for 1980626: {'created_time': 1774370751.584376, 'last_price_update_time': 1774370751.584389, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980626') HTTP/1.1" 204 0
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/2.jpg not downloaded yet
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5eb10>
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/1.jpg saved to cache
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5717450>
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/2.jpg saved to cache
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f58d0>
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/3.jpg saved to cache
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/3.jpg not downloaded yet
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/4.jpg not downloaded yet
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4fb10>
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/4.jpg saved to cache
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/5.jpg not downloaded yet
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/6.jpg not downloaded yet
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718bd0>
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/5.jpg saved to cache
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d85c90>
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/6.jpg saved to cache
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/7.jpg not downloaded yet
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/8.jpg not downloaded yet
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3c910>
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/7.jpg saved to cache
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:52 [ayvens.fr] INFO: Found listing with ID: 1980629
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980629%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [ayvens.fr] INFO: Scrape type for 1980629: 1
2026-03-24 16:45:52 [ayvens.fr] INFO: Extracting data for car ID: 1980629
2026-03-24 16:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dccac2b5-0209-5f80-a46b-d74afb052409 with identifier: 1980629
2026-03-24 16:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dccac2b5-0209-5f80-a46b-d74afb052409 with scrape type 1
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/1.jpg not downloaded yet
2026-03-24 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/2.jpg not downloaded yet
2026-03-24 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fd450>
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fcce5e8a0cb234e9893fd100b69b6f99c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/8.jpg saved to cache
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9d4b692-6866-5483-ad79-bd73fe5da92e
2026-03-24 16:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9d4b692-6866-5483-ad79-bd73fe5da92e, skipping ID generation
2026-03-24 16:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d4b692-6866-5483-ad79-bd73fe5da92e with scrape type 1
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9d4b692-6866-5483-ad79-bd73fe5da92e sending to next pipeline
2026-03-24 16:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e9d4b692-6866-5483-ad79-bd73fe5da92e, identifier: 1980627
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/3.jpg not downloaded yet
2026-03-24 16:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e9d4b692-6866-5483-ad79-bd73fe5da92e with identifier: 1980627
2026-03-24 16:45:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e9d4b692-6866-5483-ad79-bd73fe5da92e with identifier: 1980627
2026-03-24 16:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e9d4b692-6866-5483-ad79-bd73fe5da92e with identifier: 1980627 to the API
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'e9d4b692-6866-5483-ad79-bd73fe5da92e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 126126,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269606,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318377,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d4b692-6866-5483-ad79-bd73fe5da92e/e9d4b692-6866-5483-ad79-bd73fe5da92e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/cce5e8a0cb234e9893fd100b69b6f99c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-14',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 1000kg PureTech 130 S&S Worker EAT8',
'transmission': 'automatic',
'trim': 'Berlingo Van M 1000kg PureTech 130 S&S Worker EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980627%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [ayvens.fr] INFO: Saving data for 1980627: {'created_time': 1774370752.771667, 'last_price_update_time': 1774370752.771679, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980627') HTTP/1.1" 204 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/4.jpg not downloaded yet
2026-03-24 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b2490>
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/2.jpg saved to cache
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456c2d0>
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/3.jpg saved to cache
2026-03-24 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bf450>
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/1.jpg saved to cache
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5f50>
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/4.jpg saved to cache
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/5.jpg not downloaded yet
2026-03-24 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/6.jpg not downloaded yet
2026-03-24 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f3990>
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/5.jpg saved to cache
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/7.jpg not downloaded yet
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/8.jpg not downloaded yet
2026-03-24 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddc0d0>
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/6.jpg saved to cache
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4e9d0>
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/8.jpg saved to cache
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd3450>
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fd88bc31efb3349359c020c3ad904d461%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/7.jpg saved to cache
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f833bb3e-f543-542a-81cc-be1099fafad1
2026-03-24 16:45:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f833bb3e-f543-542a-81cc-be1099fafad1, skipping ID generation
2026-03-24 16:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f833bb3e-f543-542a-81cc-be1099fafad1 with scrape type 1
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f833bb3e-f543-542a-81cc-be1099fafad1 sending to next pipeline
2026-03-24 16:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f833bb3e-f543-542a-81cc-be1099fafad1, identifier: 1980628
2026-03-24 16:45:53 [ayvens.fr] INFO: Found listing with ID: 1980630
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980630%27 HTTP/1.1" 200 None
2026-03-24 16:45:53 [ayvens.fr] INFO: Scrape type for 1980630: 1
2026-03-24 16:45:53 [ayvens.fr] INFO: Extracting data for car ID: 1980630
2026-03-24 16:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdbfc161-7573-52f1-a458-ba67e6022dc9 with identifier: 1980630
2026-03-24 16:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdbfc161-7573-52f1-a458-ba67e6022dc9 with scrape type 1
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/1.jpg not downloaded yet
2026-03-24 16:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f833bb3e-f543-542a-81cc-be1099fafad1 with identifier: 1980628
2026-03-24 16:45:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f833bb3e-f543-542a-81cc-be1099fafad1 with identifier: 1980628
2026-03-24 16:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f833bb3e-f543-542a-81cc-be1099fafad1 with identifier: 1980628 to the API
2026-03-24 16:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLEU ISLAND',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid',
'id': 'f833bb3e-f543-542a-81cc-be1099fafad1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 91345,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f833bb3e-f543-542a-81cc-be1099fafad1/f833bb3e-f543-542a-81cc-be1099fafad1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/d88bc31efb3349359c020c3ad904d461/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Business',
'transmission': 'manual',
'trim': 'Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Business',
'vin': None,
'year': 2023}
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980628%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [ayvens.fr] INFO: Saving data for 1980628: {'created_time': 1774370755.022584, 'last_price_update_time': 1774370755.022596, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980628') HTTP/1.1" 204 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/2.jpg not downloaded yet
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2aad0>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/1.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6a550>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/2.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/3.jpg not downloaded yet
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/4.jpg not downloaded yet
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/5.jpg not downloaded yet
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/6.jpg not downloaded yet
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/7.jpg not downloaded yet
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/8.jpg not downloaded yet
2026-03-24 16:45:55 [ayvens.fr] INFO: Found listing with ID: 1980631
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980631%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [ayvens.fr] INFO: Scrape type for 1980631: 1
2026-03-24 16:45:55 [ayvens.fr] INFO: Extracting data for car ID: 1980631
2026-03-24 16:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02672305-3e88-5c9e-8b26-83010b980245 with identifier: 1980631
2026-03-24 16:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02672305-3e88-5c9e-8b26-83010b980245 with scrape type 1
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/1.jpg not downloaded yet
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fb510>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/3.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454e350>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/4.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/2.jpg not downloaded yet
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb4dd0>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/5.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7ec50>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/6.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82b50>
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/7.jpg saved to cache
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/3.jpg not downloaded yet
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/4.jpg not downloaded yet
2026-03-24 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4554b90>
2026-03-24 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe67849ffb6904b9ab9bcbe7d2a7831f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/8.jpg saved to cache
2026-03-24 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dccac2b5-0209-5f80-a46b-d74afb052409
2026-03-24 16:45:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dccac2b5-0209-5f80-a46b-d74afb052409, skipping ID generation
2026-03-24 16:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dccac2b5-0209-5f80-a46b-d74afb052409 with scrape type 1
2026-03-24 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dccac2b5-0209-5f80-a46b-d74afb052409 sending to next pipeline
2026-03-24 16:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dccac2b5-0209-5f80-a46b-d74afb052409, identifier: 1980629
2026-03-24 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dccac2b5-0209-5f80-a46b-d74afb052409 with identifier: 1980629
2026-03-24 16:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dccac2b5-0209-5f80-a46b-d74afb052409 with identifier: 1980629
2026-03-24 16:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dccac2b5-0209-5f80-a46b-d74afb052409 with identifier: 1980629 to the API
2026-03-24 16:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 268,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'dccac2b5-0209-5f80-a46b-d74afb052409',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 45216,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dccac2b5-0209-5f80-a46b-d74afb052409/dccac2b5-0209-5f80-a46b-d74afb052409_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e67849ffb6904b9ab9bcbe7d2a7831f8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3300 L1H2 2.3 Blue dCi 135ch Grand '
'Confort Euro6',
'transmission': 'manual',
'trim': 'Master Fg F3300 L1H2 2.3 Blue dCi 135ch Grand Confort Euro6',
'vin': None,
'year': 2022}
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980629%27 HTTP/1.1" 200 None
2026-03-24 16:45:57 [ayvens.fr] INFO: Saving data for 1980629: {'created_time': 1774370757.545162, 'last_price_update_time': 1774370757.545174, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980629') HTTP/1.1" 204 0
2026-03-24 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/5.jpg not downloaded yet
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a5890>
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/1.jpg saved to cache
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454ccd0>
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/2.jpg saved to cache
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ca5490>
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/3.jpg saved to cache
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/6.jpg not downloaded yet
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da61d0>
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/7.jpg saved to cache
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/7.jpg not downloaded yet
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb7c90>
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/4.jpg saved to cache
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57157d0>
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/6.jpg saved to cache
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/8.jpg not downloaded yet
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ca6150>
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/5.jpg saved to cache
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb57d0>
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5d37a7e0422e4648a4cf0190ada83936%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/8.jpg saved to cache
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdbfc161-7573-52f1-a458-ba67e6022dc9
2026-03-24 16:45:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdbfc161-7573-52f1-a458-ba67e6022dc9, skipping ID generation
2026-03-24 16:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdbfc161-7573-52f1-a458-ba67e6022dc9 with scrape type 1
2026-03-24 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdbfc161-7573-52f1-a458-ba67e6022dc9 sending to next pipeline
2026-03-24 16:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fdbfc161-7573-52f1-a458-ba67e6022dc9, identifier: 1980630
2026-03-24 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fdbfc161-7573-52f1-a458-ba67e6022dc9 with identifier: 1980630
2026-03-24 16:45:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fdbfc161-7573-52f1-a458-ba67e6022dc9 with identifier: 1980630
2026-03-24 16:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fdbfc161-7573-52f1-a458-ba67e6022dc9 with identifier: 1980630 to the API
2026-03-24 16:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'BLANC OKENITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'fdbfc161-7573-52f1-a458-ba67e6022dc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '408',
'odometer': 39242,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340874,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdbfc161-7573-52f1-a458-ba67e6022dc9/fdbfc161-7573-52f1-a458-ba67e6022dc9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5d37a7e0422e4648a4cf0190ada83936/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 408 408 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '408 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980630%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [ayvens.fr] INFO: Saving data for 1980630: {'created_time': 1774370759.135824, 'last_price_update_time': 1774370759.135838, 'auction_closing_time': 1774605600.0}
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980630') HTTP/1.1" 204 0
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [ayvens.fr] INFO: Found listing with ID: 1980632
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980632%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [ayvens.fr] INFO: Scrape type for 1980632: 1
2026-03-24 16:45:59 [ayvens.fr] INFO: Extracting data for car ID: 1980632
2026-03-24 16:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 with identifier: 1980632
2026-03-24 16:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 with scrape type 1
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/1.jpg not downloaded yet
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/2.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81510>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/1.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/3.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/4.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84650>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/2.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7ee50>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/3.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bd890>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/4.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1b4d0>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/5.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/5.jpg not downloaded yet
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/6.jpg not downloaded yet
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb8450>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/6.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb8290>
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/7.jpg saved to cache
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/7.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/8.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [ayvens.fr] INFO: Found listing with ID: 1980633
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980633%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [ayvens.fr] INFO: Scrape type for 1980633: 1
2026-03-24 16:45:59 [ayvens.fr] INFO: Extracting data for car ID: 1980633
2026-03-24 16:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbd2efc1-5ad9-52c7-a71c-0567f8f761fe with identifier: 1980633
2026-03-24 16:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe with scrape type 1
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/1.jpg not downloaded yet
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/2.jpg not downloaded yet
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/3.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/4.jpg not downloaded yet
2026-03-24 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/5.jpg not downloaded yet
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c2ad0>
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52c78db5a83441508e95e5a9ddb012e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/8.jpg saved to cache
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02672305-3e88-5c9e-8b26-83010b980245
2026-03-24 16:46:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02672305-3e88-5c9e-8b26-83010b980245, skipping ID generation
2026-03-24 16:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02672305-3e88-5c9e-8b26-83010b980245 with scrape type 1
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02672305-3e88-5c9e-8b26-83010b980245 sending to next pipeline
2026-03-24 16:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 02672305-3e88-5c9e-8b26-83010b980245, identifier: 1980631
2026-03-24 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/6.jpg not downloaded yet
2026-03-24 16:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 02672305-3e88-5c9e-8b26-83010b980245 with identifier: 1980631
2026-03-24 16:46:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 02672305-3e88-5c9e-8b26-83010b980245 with identifier: 1980631
2026-03-24 16:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 02672305-3e88-5c9e-8b26-83010b980245 with identifier: 1980631 to the API
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'URBAN GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '02672305-3e88-5c9e-8b26-83010b980245',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BYD',
'model': 'DOLPHIN',
'odometer': 4751,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02672305-3e88-5c9e-8b26-83010b980245/02672305-3e88-5c9e-8b26-83010b980245_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52c78db5a83441508e95e5a9ddb012e2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'BYD DOLPHIN Dolphin 204ch - 60,4 kWh Comfort',
'transmission': 'automatic',
'trim': 'Dolphin 204ch - 60,4 kWh Comfort',
'vin': None,
'year': 2024}
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980631%27 HTTP/1.1" 200 None
2026-03-24 16:46:00 [ayvens.fr] INFO: Saving data for 1980631: {'created_time': 1774370760.880976, 'last_price_update_time': 1774370760.880989, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980631') HTTP/1.1" 204 0
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce1050>
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/1.jpg saved to cache
2026-03-24 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cea590>
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/2.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/7.jpg not downloaded yet
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc17d0>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/3.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454e990>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/4.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5727610>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/7.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/8.jpg not downloaded yet
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [ayvens.fr] INFO: Found listing with ID: 1980634
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980634%27 HTTP/1.1" 200 None
2026-03-24 16:46:01 [ayvens.fr] INFO: Scrape type for 1980634: 1
2026-03-24 16:46:01 [ayvens.fr] INFO: Extracting data for car ID: 1980634
2026-03-24 16:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 with identifier: 1980634
2026-03-24 16:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 with scrape type 1
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/1.jpg not downloaded yet
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9a10>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/6.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a7b10>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/5.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/2.jpg not downloaded yet
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/3.jpg not downloaded yet
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc2c50>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/1.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84bd0>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/3.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9c9d0>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/2.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60290>
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fha-%252Fa05b6e7c9fd346389b1b7688ef39fa8a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/8.jpg saved to cache
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83
2026-03-24 16:46:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83, skipping ID generation
2026-03-24 16:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 with scrape type 1
2026-03-24 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 sending to next pipeline
2026-03-24 16:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83, identifier: 1980632
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/4.jpg not downloaded yet
2026-03-24 16:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 with identifier: 1980632
2026-03-24 16:46:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 with identifier: 1980632
2026-03-24 16:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83 with identifier: 1980632 to the API
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-03-24 16:46:02 [crawlers.pipelines.post_to_api] ERROR: ayvens.fr, item_id 29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Color","ErrorMessage":"color value can only be expressed in letters","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 24 Mar 2026 16:46:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-03-24 16:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 63713,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293424,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83/29c8e7e9-ad7c-5cf0-9bc0-307c1cfefe83_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ha-/a05b6e7c9fd346389b1b7688ef39fa8a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Allure EAT8',
'vin': None,
'year': 2024}
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980632%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [ayvens.fr] INFO: Saving data for 1980632: {'created_time': 1774370762.26279, 'last_price_update_time': 1774370762.262801, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980632') HTTP/1.1" 204 0
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/5.jpg not downloaded yet
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5badc50>
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/5.jpg saved to cache
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d31190>
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/4.jpg saved to cache
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/6.jpg not downloaded yet
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5de90>
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/6.jpg saved to cache
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be1550>
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/7.jpg saved to cache
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/7.jpg not downloaded yet
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/8.jpg not downloaded yet
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [ayvens.fr] INFO: Found listing with ID: 1980635
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980635%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [ayvens.fr] INFO: Scrape type for 1980635: 1
2026-03-24 16:46:02 [ayvens.fr] INFO: Extracting data for car ID: 1980635
2026-03-24 16:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a19336cd-bf91-57dd-98d3-52c4f9fdfd35 with identifier: 1980635
2026-03-24 16:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35 with scrape type 1
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/1.jpg not downloaded yet
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/2.jpg not downloaded yet
2026-03-24 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/3.jpg not downloaded yet
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/4.jpg not downloaded yet
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c1f10>
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1908ad318ff5420d9ddcc2994dbf0742%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/8.jpg saved to cache
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe
2026-03-24 16:46:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbd2efc1-5ad9-52c7-a71c-0567f8f761fe, skipping ID generation
2026-03-24 16:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe with scrape type 1
2026-03-24 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbd2efc1-5ad9-52c7-a71c-0567f8f761fe sending to next pipeline
2026-03-24 16:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bbd2efc1-5ad9-52c7-a71c-0567f8f761fe, identifier: 1980633
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5c1d0>
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/1.jpg saved to cache
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/5.jpg not downloaded yet
2026-03-24 16:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bbd2efc1-5ad9-52c7-a71c-0567f8f761fe with identifier: 1980633
2026-03-24 16:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bbd2efc1-5ad9-52c7-a71c-0567f8f761fe with identifier: 1980633
2026-03-24 16:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bbd2efc1-5ad9-52c7-a71c-0567f8f761fe with identifier: 1980633 to the API
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'bbd2efc1-5ad9-52c7-a71c-0567f8f761fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 127982,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292026,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269423,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd2efc1-5ad9-52c7-a71c-0567f8f761fe/bbd2efc1-5ad9-52c7-a71c-0567f8f761fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1908ad318ff5420d9ddcc2994dbf0742/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN Touran 2.0 TDI 150ch FAP Lounge Business DSG7 5 '
'places Euro6dT',
'transmission': 'automatic',
'trim': 'Touran 2.0 TDI 150ch FAP Lounge Business DSG7 5 places Euro6dT',
'vin': None,
'year': 2022}
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980633%27 HTTP/1.1" 200 None
2026-03-24 16:46:03 [ayvens.fr] INFO: Saving data for 1980633: {'created_time': 1774370763.713581, 'last_price_update_time': 1774370763.713593, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980633') HTTP/1.1" 204 0
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/6.jpg not downloaded yet
2026-03-24 16:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/7.jpg not downloaded yet
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e610>
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/2.jpg saved to cache
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c37d0>
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/3.jpg saved to cache
2026-03-24 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f1ed0>
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/4.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/8.jpg not downloaded yet
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [ayvens.fr] INFO: Found listing with ID: 1980636
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980636%27 HTTP/1.1" 200 None
2026-03-24 16:46:04 [ayvens.fr] INFO: Scrape type for 1980636: 1
2026-03-24 16:46:04 [ayvens.fr] INFO: Extracting data for car ID: 1980636
2026-03-24 16:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5053c368-d9e3-59cd-bbbe-6388a414592c with identifier: 1980636
2026-03-24 16:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5053c368-d9e3-59cd-bbbe-6388a414592c with scrape type 1
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/1.jpg not downloaded yet
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19b10>
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/8.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/2.jpg not downloaded yet
2026-03-24 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/3.jpg not downloaded yet
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e45750>
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/7.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d350>
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/5.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459add0>
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F600a4e5d97144b8cb5150aef6eec310d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/6.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478
2026-03-24 16:46:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478, skipping ID generation
2026-03-24 16:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 with scrape type 1
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 sending to next pipeline
2026-03-24 16:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478, identifier: 1980634
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1690>
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/2.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf6450>
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/1.jpg saved to cache
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/4.jpg not downloaded yet
2026-03-24 16:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 with identifier: 1980634
2026-03-24 16:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 with identifier: 1980634
2026-03-24 16:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 915c5ffa-5e9d-5c2e-98aa-f0c92cc15478 with identifier: 1980634 to the API
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '915c5ffa-5e9d-5c2e-98aa-f0c92cc15478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 121555,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915c5ffa-5e9d-5c2e-98aa-f0c92cc15478/915c5ffa-5e9d-5c2e-98aa-f0c92cc15478_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/600a4e5d97144b8cb5150aef6eec310d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN JUKE Juke 1.0 DIG-T 114ch N-Connecta DCT',
'transmission': 'automatic',
'trim': 'Juke 1.0 DIG-T 114ch N-Connecta DCT',
'vin': None,
'year': 2022}
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980634%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [ayvens.fr] INFO: Saving data for 1980634: {'created_time': 1774370765.051862, 'last_price_update_time': 1774370765.051875, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980634') HTTP/1.1" 204 0
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b6d10>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/3.jpg saved to cache
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/5.jpg not downloaded yet
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5a8d0>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/4.jpg saved to cache
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/6.jpg not downloaded yet
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/7.jpg not downloaded yet
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/8.jpg not downloaded yet
2026-03-24 16:46:05 [ayvens.fr] INFO: Found listing with ID: 1980637
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980637%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [ayvens.fr] INFO: Scrape type for 1980637: 1
2026-03-24 16:46:05 [ayvens.fr] INFO: Extracting data for car ID: 1980637
2026-03-24 16:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab23b66f-5369-524a-9248-7409ca9b0d1f with identifier: 1980637
2026-03-24 16:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab23b66f-5369-524a-9248-7409ca9b0d1f with scrape type 1
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/1.jpg not downloaded yet
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/2.jpg not downloaded yet
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c73690>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/5.jpg saved to cache
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/3.jpg not downloaded yet
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf5790>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/7.jpg saved to cache
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666cc90>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/6.jpg saved to cache
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/4.jpg not downloaded yet
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7bd0>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb80b6745da4d4edfa040a707558fc97d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/8.jpg saved to cache
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35
2026-03-24 16:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a19336cd-bf91-57dd-98d3-52c4f9fdfd35, skipping ID generation
2026-03-24 16:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35 with scrape type 1
2026-03-24 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a19336cd-bf91-57dd-98d3-52c4f9fdfd35 sending to next pipeline
2026-03-24 16:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a19336cd-bf91-57dd-98d3-52c4f9fdfd35, identifier: 1980635
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718210>
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/1.jpg saved to cache
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a19336cd-bf91-57dd-98d3-52c4f9fdfd35 with identifier: 1980635
2026-03-24 16:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a19336cd-bf91-57dd-98d3-52c4f9fdfd35 with identifier: 1980635
2026-03-24 16:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a19336cd-bf91-57dd-98d3-52c4f9fdfd35 with identifier: 1980635 to the API
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'a19336cd-bf91-57dd-98d3-52c4f9fdfd35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 49844,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a19336cd-bf91-57dd-98d3-52c4f9fdfd35/a19336cd-bf91-57dd-98d3-52c4f9fdfd35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b80b6745da4d4edfa040a707558fc97d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-25',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Business R',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Business R',
'vin': None,
'year': 2021}
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980635%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [ayvens.fr] INFO: Saving data for 1980635: {'created_time': 1774370766.467368, 'last_price_update_time': 1774370766.467379, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980635') HTTP/1.1" 204 0
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d61d90>
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/2.jpg saved to cache
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/5.jpg not downloaded yet
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5ff50>
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/4.jpg saved to cache
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/6.jpg not downloaded yet
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/7.jpg not downloaded yet
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 8 pages/min), scraped 27 items (at 27 items/min)
2026-03-24 16:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/8.jpg not downloaded yet
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba2fd0>
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/3.jpg saved to cache
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:06 [ayvens.fr] INFO: Found listing with ID: 1980638
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980638%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [ayvens.fr] INFO: Scrape type for 1980638: 1
2026-03-24 16:46:06 [ayvens.fr] INFO: Extracting data for car ID: 1980638
2026-03-24 16:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39484a62-f52e-5a1a-aec1-b14c128c4f24 with identifier: 1980638
2026-03-24 16:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39484a62-f52e-5a1a-aec1-b14c128c4f24 with scrape type 1
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/1.jpg not downloaded yet
2026-03-24 16:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd6e90>
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/6.jpg saved to cache
2026-03-24 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c3450>
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/7.jpg saved to cache
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/2.jpg not downloaded yet
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9590>
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/5.jpg saved to cache
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457de90>
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F58c6cafb77f445548df6dd72a08e5dca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/8.jpg saved to cache
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5053c368-d9e3-59cd-bbbe-6388a414592c
2026-03-24 16:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5053c368-d9e3-59cd-bbbe-6388a414592c, skipping ID generation
2026-03-24 16:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5053c368-d9e3-59cd-bbbe-6388a414592c with scrape type 1
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5053c368-d9e3-59cd-bbbe-6388a414592c sending to next pipeline
2026-03-24 16:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5053c368-d9e3-59cd-bbbe-6388a414592c, identifier: 1980636
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4de50>
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/1.jpg saved to cache
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb6750>
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/2.jpg saved to cache
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/3.jpg not downloaded yet
2026-03-24 16:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5053c368-d9e3-59cd-bbbe-6388a414592c with identifier: 1980636
2026-03-24 16:46:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5053c368-d9e3-59cd-bbbe-6388a414592c with identifier: 1980636
2026-03-24 16:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5053c368-d9e3-59cd-bbbe-6388a414592c with identifier: 1980636 to the API
2026-03-24 16:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '5053c368-d9e3-59cd-bbbe-6388a414592c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 96782,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5053c368-d9e3-59cd-bbbe-6388a414592c/5053c368-d9e3-59cd-bbbe-6388a414592c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/58c6cafb77f445548df6dd72a08e5dca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980636%27 HTTP/1.1" 200 None
2026-03-24 16:46:08 [ayvens.fr] INFO: Saving data for 1980636: {'created_time': 1774370768.428473, 'last_price_update_time': 1774370768.428484, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980636') HTTP/1.1" 204 0
2026-03-24 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c62f10>
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/3.jpg saved to cache
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/4.jpg not downloaded yet
2026-03-24 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/5.jpg not downloaded yet
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/6.jpg not downloaded yet
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f3810>
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/6.jpg saved to cache
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/7.jpg not downloaded yet
2026-03-24 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/8.jpg not downloaded yet
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d859d0>
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/4.jpg saved to cache
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60c90>
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/5.jpg saved to cache
2026-03-24 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f4f10>
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/7.jpg saved to cache
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccfe50>
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F079eb1d06164406fa98d84dd954ed393%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/8.jpg saved to cache
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab23b66f-5369-524a-9248-7409ca9b0d1f
2026-03-24 16:46:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab23b66f-5369-524a-9248-7409ca9b0d1f, skipping ID generation
2026-03-24 16:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab23b66f-5369-524a-9248-7409ca9b0d1f with scrape type 1
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab23b66f-5369-524a-9248-7409ca9b0d1f sending to next pipeline
2026-03-24 16:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ab23b66f-5369-524a-9248-7409ca9b0d1f, identifier: 1980637
2026-03-24 16:46:09 [ayvens.fr] INFO: Found listing with ID: 1980639
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980639%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [ayvens.fr] INFO: Scrape type for 1980639: 1
2026-03-24 16:46:09 [ayvens.fr] INFO: Extracting data for car ID: 1980639
2026-03-24 16:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a47268-e74b-5127-affd-9b99382f836a with identifier: 1980639
2026-03-24 16:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a47268-e74b-5127-affd-9b99382f836a with scrape type 1
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/1.jpg not downloaded yet
2026-03-24 16:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ab23b66f-5369-524a-9248-7409ca9b0d1f with identifier: 1980637
2026-03-24 16:46:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ab23b66f-5369-524a-9248-7409ca9b0d1f with identifier: 1980637
2026-03-24 16:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ab23b66f-5369-524a-9248-7409ca9b0d1f with identifier: 1980637 to the API
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'SHOOTING STAR GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'ab23b66f-5369-524a-9248-7409ca9b0d1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'IONIQ 5',
'odometer': 73872,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab23b66f-5369-524a-9248-7409ca9b0d1f/ab23b66f-5369-524a-9248-7409ca9b0d1f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/079eb1d06164406fa98d84dd954ed393/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI IONIQ 5 Ioniq 5 77 kWh - 229ch Executive',
'transmission': 'automatic',
'trim': 'Ioniq 5 77 kWh - 229ch Executive',
'vin': None,
'year': 2023}
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980637%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [ayvens.fr] INFO: Saving data for 1980637: {'created_time': 1774370769.78946, 'last_price_update_time': 1774370769.789472, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980637') HTTP/1.1" 204 0
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5e610>
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/1.jpg saved to cache
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/2.jpg not downloaded yet
2026-03-24 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/3.jpg not downloaded yet
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/4.jpg not downloaded yet
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/5.jpg not downloaded yet
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/6.jpg not downloaded yet
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/7.jpg not downloaded yet
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/8.jpg not downloaded yet
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5790>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/2.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [ayvens.fr] INFO: Found listing with ID: 1980640
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980640%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [ayvens.fr] INFO: Scrape type for 1980640: 1
2026-03-24 16:46:10 [ayvens.fr] INFO: Extracting data for car ID: 1980640
2026-03-24 16:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f4c83f-52b9-521f-a16f-0d451573da48 with identifier: 1980640
2026-03-24 16:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f4c83f-52b9-521f-a16f-0d451573da48 with scrape type 1
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/1.jpg not downloaded yet
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d30b90>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/4.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a05150>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/3.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3d90>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/6.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0a190>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/5.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570f250>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/7.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/2.jpg not downloaded yet
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/3.jpg not downloaded yet
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/4.jpg not downloaded yet
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/5.jpg not downloaded yet
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/6.jpg not downloaded yet
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/7.jpg not downloaded yet
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/8.jpg not downloaded yet
2026-03-24 16:46:10 [ayvens.fr] INFO: Found listing with ID: 1980641
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980641%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [ayvens.fr] INFO: Scrape type for 1980641: 1
2026-03-24 16:46:10 [ayvens.fr] INFO: Extracting data for car ID: 1980641
2026-03-24 16:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f33ab44a-2e3d-5479-baab-007bf0bff837 with identifier: 1980641
2026-03-24 16:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33ab44a-2e3d-5479-baab-007bf0bff837 with scrape type 1
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/1.jpg not downloaded yet
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/2.jpg not downloaded yet
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0ad0>
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fc019e27255c7473f841e2fcaaacc5ba3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/8.jpg saved to cache
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39484a62-f52e-5a1a-aec1-b14c128c4f24
2026-03-24 16:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39484a62-f52e-5a1a-aec1-b14c128c4f24, skipping ID generation
2026-03-24 16:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39484a62-f52e-5a1a-aec1-b14c128c4f24 with scrape type 1
2026-03-24 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39484a62-f52e-5a1a-aec1-b14c128c4f24 sending to next pipeline
2026-03-24 16:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 39484a62-f52e-5a1a-aec1-b14c128c4f24, identifier: 1980638
2026-03-24 16:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 39484a62-f52e-5a1a-aec1-b14c128c4f24 with identifier: 1980638
2026-03-24 16:46:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 39484a62-f52e-5a1a-aec1-b14c128c4f24 with identifier: 1980638
2026-03-24 16:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 39484a62-f52e-5a1a-aec1-b14c128c4f24 with identifier: 1980638 to the API
2026-03-24 16:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '39484a62-f52e-5a1a-aec1-b14c128c4f24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 119583,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39484a62-f52e-5a1a-aec1-b14c128c4f24/39484a62-f52e-5a1a-aec1-b14c128c4f24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/c019e27255c7473f841e2fcaaacc5ba3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-12',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980638%27 HTTP/1.1" 200 None
2026-03-24 16:46:11 [ayvens.fr] INFO: Saving data for 1980638: {'created_time': 1774370771.432325, 'last_price_update_time': 1774370771.432363, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980638') HTTP/1.1" 204 0
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/3.jpg not downloaded yet
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e30fd0>
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/1.jpg saved to cache
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a0750>
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/3.jpg saved to cache
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613f110>
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/2.jpg saved to cache
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61028d0>
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/4.jpg saved to cache
2026-03-24 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613dd90>
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/5.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6147ad0>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/6.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613cc10>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/7.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/4.jpg not downloaded yet
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/5.jpg not downloaded yet
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/6.jpg not downloaded yet
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/7.jpg not downloaded yet
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/8.jpg not downloaded yet
2026-03-24 16:46:12 [ayvens.fr] INFO: Found listing with ID: 1980642
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980642%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [ayvens.fr] INFO: Scrape type for 1980642: 1
2026-03-24 16:46:12 [ayvens.fr] INFO: Extracting data for car ID: 1980642
2026-03-24 16:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 299a31da-0a8f-55bb-b01c-f817757825b8 with identifier: 1980642
2026-03-24 16:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299a31da-0a8f-55bb-b01c-f817757825b8 with scrape type 1
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/1.jpg not downloaded yet
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/2.jpg not downloaded yet
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/3.jpg not downloaded yet
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5e310>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/3.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2d90>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/1.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457e910>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/2.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd2c90>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/4.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0b690>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/6.jpg saved to cache
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/4.jpg not downloaded yet
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60250>
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/7.jpg saved to cache
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da5390>
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/5.jpg saved to cache
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75dd0>
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7eb2f88e015b44c5b7856edd1f5c71be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/8.jpg saved to cache
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10a47268-e74b-5127-affd-9b99382f836a
2026-03-24 16:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10a47268-e74b-5127-affd-9b99382f836a, skipping ID generation
2026-03-24 16:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a47268-e74b-5127-affd-9b99382f836a with scrape type 1
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10a47268-e74b-5127-affd-9b99382f836a sending to next pipeline
2026-03-24 16:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 10a47268-e74b-5127-affd-9b99382f836a, identifier: 1980639
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/5.jpg not downloaded yet
2026-03-24 16:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 10a47268-e74b-5127-affd-9b99382f836a with identifier: 1980639
2026-03-24 16:46:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 10a47268-e74b-5127-affd-9b99382f836a with identifier: 1980639
2026-03-24 16:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 10a47268-e74b-5127-affd-9b99382f836a with identifier: 1980639 to the API
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 34,
'color': 'SAPHIR SCHWARTZ METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '10a47268-e74b-5127-affd-9b99382f836a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 73257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a47268-e74b-5127-affd-9b99382f836a/10a47268-e74b-5127-affd-9b99382f836a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7eb2f88e015b44c5b7856edd1f5c71be/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Série 3 Touring 320eA xDrive 204ch Business Design',
'transmission': 'automatic',
'trim': 'Série 3 Touring 320eA xDrive 204ch Business Design',
'vin': None,
'year': 2023}
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980639%27 HTTP/1.1" 200 None
2026-03-24 16:46:13 [ayvens.fr] INFO: Saving data for 1980639: {'created_time': 1774370773.789655, 'last_price_update_time': 1774370773.789666, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980639') HTTP/1.1" 204 0
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/6.jpg not downloaded yet
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/7.jpg not downloaded yet
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e440d0>
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F936ca76d73ad4c84bfdc0a4f8641b02c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/8.jpg saved to cache
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15f4c83f-52b9-521f-a16f-0d451573da48
2026-03-24 16:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15f4c83f-52b9-521f-a16f-0d451573da48, skipping ID generation
2026-03-24 16:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f4c83f-52b9-521f-a16f-0d451573da48 with scrape type 1
2026-03-24 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15f4c83f-52b9-521f-a16f-0d451573da48 sending to next pipeline
2026-03-24 16:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 15f4c83f-52b9-521f-a16f-0d451573da48, identifier: 1980640
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce190>
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/7.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 15f4c83f-52b9-521f-a16f-0d451573da48 with identifier: 1980640
2026-03-24 16:46:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 15f4c83f-52b9-521f-a16f-0d451573da48 with identifier: 1980640
2026-03-24 16:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 15f4c83f-52b9-521f-a16f-0d451573da48 with identifier: 1980640 to the API
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'SKYSCRAPER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '15f4c83f-52b9-521f-a16f-0d451573da48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 ACTIVE TOURE',
'odometer': 29050,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4c83f-52b9-521f-a16f-0d451573da48/15f4c83f-52b9-521f-a16f-0d451573da48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/936ca76d73ad4c84bfdc0a4f8641b02c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 2 ACTIVE TOURE Série 2 ActiveTourer 218i 136ch Business '
'Design DKG7',
'transmission': 'automatic',
'trim': 'Série 2 ActiveTourer 218i 136ch Business Design DKG7',
'vin': None,
'year': 2024}
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980640%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [ayvens.fr] INFO: Saving data for 1980640: {'created_time': 1774370774.400615, 'last_price_update_time': 1774370774.400626, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980640') HTTP/1.1" 204 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/8.jpg not downloaded yet
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fe4d0>
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/3.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60efa50>
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/5.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d733d0>
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/1.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cae9d0>
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/4.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d73210>
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/6.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [ayvens.fr] INFO: Found listing with ID: 1980643
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980643%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [ayvens.fr] INFO: Scrape type for 1980643: 1
2026-03-24 16:46:14 [ayvens.fr] INFO: Extracting data for car ID: 1980643
2026-03-24 16:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae33688-7270-59f0-98bd-9a7c534ecfd4 with identifier: 1980643
2026-03-24 16:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae33688-7270-59f0-98bd-9a7c534ecfd4 with scrape type 1
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/1.jpg not downloaded yet
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e819db90>
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/2.jpg saved to cache
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/2.jpg not downloaded yet
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/3.jpg not downloaded yet
2026-03-24 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/4.jpg not downloaded yet
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/5.jpg not downloaded yet
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/6.jpg not downloaded yet
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/7.jpg not downloaded yet
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/8.jpg not downloaded yet
2026-03-24 16:46:15 [ayvens.fr] INFO: Found listing with ID: 1980644
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980644%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [ayvens.fr] INFO: Scrape type for 1980644: 1
2026-03-24 16:46:15 [ayvens.fr] INFO: Extracting data for car ID: 1980644
2026-03-24 16:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 732f96f8-6e54-5783-9aec-3c29ed272b90 with identifier: 1980644
2026-03-24 16:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732f96f8-6e54-5783-9aec-3c29ed272b90 with scrape type 1
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/1.jpg not downloaded yet
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/2.jpg not downloaded yet
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c56710>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fbcc1096b6999437ba057287af25b0a37%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/8.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f33ab44a-2e3d-5479-baab-007bf0bff837
2026-03-24 16:46:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f33ab44a-2e3d-5479-baab-007bf0bff837, skipping ID generation
2026-03-24 16:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33ab44a-2e3d-5479-baab-007bf0bff837 with scrape type 1
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f33ab44a-2e3d-5479-baab-007bf0bff837 sending to next pipeline
2026-03-24 16:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f33ab44a-2e3d-5479-baab-007bf0bff837, identifier: 1980641
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60432d0>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/1.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b848d0>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/3.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0e10>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/4.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617f6d0>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/5.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e619aed0>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/2.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b84850>
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/6.jpg saved to cache
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/3.jpg not downloaded yet
2026-03-24 16:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f33ab44a-2e3d-5479-baab-007bf0bff837 with identifier: 1980641
2026-03-24 16:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f33ab44a-2e3d-5479-baab-007bf0bff837 with identifier: 1980641
2026-03-24 16:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f33ab44a-2e3d-5479-baab-007bf0bff837 with identifier: 1980641 to the API
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'f33ab44a-2e3d-5479-baab-007bf0bff837',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 116716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447255,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254756,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f33ab44a-2e3d-5479-baab-007bf0bff837/f33ab44a-2e3d-5479-baab-007bf0bff837_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/bcc1096b6999437ba057287af25b0a37/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980641%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [ayvens.fr] INFO: Saving data for 1980641: {'created_time': 1774370776.476914, 'last_price_update_time': 1774370776.476928, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980641') HTTP/1.1" 204 0
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/4.jpg not downloaded yet
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/5.jpg not downloaded yet
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459b290>
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/7.jpg saved to cache
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/6.jpg not downloaded yet
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/7.jpg not downloaded yet
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/8.jpg not downloaded yet
2026-03-24 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:16 [ayvens.fr] INFO: Found listing with ID: 1980645
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980645%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [ayvens.fr] INFO: Scrape type for 1980645: 1
2026-03-24 16:46:16 [ayvens.fr] INFO: Extracting data for car ID: 1980645
2026-03-24 16:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7de1524-c495-514c-bb5f-bb4ea8273cd7 with identifier: 1980645
2026-03-24 16:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7de1524-c495-514c-bb5f-bb4ea8273cd7 with scrape type 1
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/1.jpg not downloaded yet
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81490>
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfd2bcacb2d74af984aeddcb7b1d8f57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/8.jpg saved to cache
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 299a31da-0a8f-55bb-b01c-f817757825b8
2026-03-24 16:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 299a31da-0a8f-55bb-b01c-f817757825b8, skipping ID generation
2026-03-24 16:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299a31da-0a8f-55bb-b01c-f817757825b8 with scrape type 1
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 299a31da-0a8f-55bb-b01c-f817757825b8 sending to next pipeline
2026-03-24 16:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 299a31da-0a8f-55bb-b01c-f817757825b8, identifier: 1980642
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6126010>
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/1.jpg saved to cache
2026-03-24 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 299a31da-0a8f-55bb-b01c-f817757825b8 with identifier: 1980642
2026-03-24 16:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 299a31da-0a8f-55bb-b01c-f817757825b8 with identifier: 1980642
2026-03-24 16:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 299a31da-0a8f-55bb-b01c-f817757825b8 with identifier: 1980642 to the API
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '299a31da-0a8f-55bb-b01c-f817757825b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 56439,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299a31da-0a8f-55bb-b01c-f817757825b8/299a31da-0a8f-55bb-b01c-f817757825b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfd2bcacb2d74af984aeddcb7b1d8f57/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980642%27 HTTP/1.1" 200 None
2026-03-24 16:46:17 [ayvens.fr] INFO: Saving data for 1980642: {'created_time': 1774370777.556383, 'last_price_update_time': 1774370777.556396, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980642') HTTP/1.1" 204 0
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/2.jpg not downloaded yet
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/3.jpg not downloaded yet
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddff50>
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/5.jpg saved to cache
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7dcd0>
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/6.jpg saved to cache
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b844d0>
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/4.jpg saved to cache
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b86d90>
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/2.jpg saved to cache
2026-03-24 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7f890>
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/3.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc5e10>
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/7.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/4.jpg not downloaded yet
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/5.jpg not downloaded yet
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/6.jpg not downloaded yet
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/7.jpg not downloaded yet
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/8.jpg not downloaded yet
2026-03-24 16:46:18 [ayvens.fr] INFO: Found listing with ID: 1980646
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980646%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [ayvens.fr] INFO: Scrape type for 1980646: 1
2026-03-24 16:46:18 [ayvens.fr] INFO: Extracting data for car ID: 1980646
2026-03-24 16:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 with identifier: 1980646
2026-03-24 16:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 with scrape type 1
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/1.jpg not downloaded yet
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/2.jpg not downloaded yet
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/3.jpg not downloaded yet
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcfa90>
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb2e498b2f35e4f918065a9f3878092bc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/8.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eae33688-7270-59f0-98bd-9a7c534ecfd4
2026-03-24 16:46:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eae33688-7270-59f0-98bd-9a7c534ecfd4, skipping ID generation
2026-03-24 16:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae33688-7270-59f0-98bd-9a7c534ecfd4 with scrape type 1
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eae33688-7270-59f0-98bd-9a7c534ecfd4 sending to next pipeline
2026-03-24 16:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: eae33688-7270-59f0-98bd-9a7c534ecfd4, identifier: 1980643
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617d0d0>
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/5.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e4d0>
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/6.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcdbd0>
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/4.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b84550>
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/7.jpg saved to cache
2026-03-24 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: eae33688-7270-59f0-98bd-9a7c534ecfd4 with identifier: 1980643
2026-03-24 16:46:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: eae33688-7270-59f0-98bd-9a7c534ecfd4 with identifier: 1980643
2026-03-24 16:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: eae33688-7270-59f0-98bd-9a7c534ecfd4 with identifier: 1980643 to the API
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'eae33688-7270-59f0-98bd-9a7c534ecfd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 21585,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eae33688-7270-59f0-98bd-9a7c534ecfd4/eae33688-7270-59f0-98bd-9a7c534ecfd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262432,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b2e498b2f35e4f918065a9f3878092bc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Dolcevita',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Dolcevita',
'vin': None,
'year': 2022}
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980643%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [ayvens.fr] INFO: Saving data for 1980643: {'created_time': 1774370779.188641, 'last_price_update_time': 1774370779.188694, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980643') HTTP/1.1" 204 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/4.jpg not downloaded yet
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d11e10>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/1.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d0a50>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/2.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573b5d0>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/3.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/5.jpg not downloaded yet
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/6.jpg not downloaded yet
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/7.jpg not downloaded yet
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/8.jpg not downloaded yet
2026-03-24 16:46:19 [ayvens.fr] INFO: Found listing with ID: 1980647
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980647%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [ayvens.fr] INFO: Scrape type for 1980647: 1
2026-03-24 16:46:19 [ayvens.fr] INFO: Extracting data for car ID: 1980647
2026-03-24 16:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7c2cb1c-7256-5960-9b3a-e33ca7bd971f with identifier: 1980647
2026-03-24 16:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f with scrape type 1
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/1.jpg not downloaded yet
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/2.jpg not downloaded yet
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/3.jpg not downloaded yet
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b57850>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/2.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df8ed0>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/7.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d021d0>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/6.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df80d0>
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252Fa3e7f620527a4434803ee98912e6f673%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/8.jpg saved to cache
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 732f96f8-6e54-5783-9aec-3c29ed272b90
2026-03-24 16:46:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 732f96f8-6e54-5783-9aec-3c29ed272b90, skipping ID generation
2026-03-24 16:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732f96f8-6e54-5783-9aec-3c29ed272b90 with scrape type 1
2026-03-24 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 732f96f8-6e54-5783-9aec-3c29ed272b90 sending to next pipeline
2026-03-24 16:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 732f96f8-6e54-5783-9aec-3c29ed272b90, identifier: 1980644
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/4.jpg not downloaded yet
2026-03-24 16:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 732f96f8-6e54-5783-9aec-3c29ed272b90 with identifier: 1980644
2026-03-24 16:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 732f96f8-6e54-5783-9aec-3c29ed272b90 with identifier: 1980644
2026-03-24 16:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 732f96f8-6e54-5783-9aec-3c29ed272b90 with identifier: 1980644 to the API
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '732f96f8-6e54-5783-9aec-3c29ed272b90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 96900,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381143,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732f96f8-6e54-5783-9aec-3c29ed272b90/732f96f8-6e54-5783-9aec-3c29ed272b90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/a3e7f620527a4434803ee98912e6f673/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch E6.c S&S Active Business '
'EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.2 PureTech 130ch E6.c S&S Active Business EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980644%27 HTTP/1.1" 200 None
2026-03-24 16:46:20 [ayvens.fr] INFO: Saving data for 1980644: {'created_time': 1774370780.742166, 'last_price_update_time': 1774370780.742178, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980644') HTTP/1.1" 204 0
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc06d0>
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/5.jpg saved to cache
2026-03-24 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddde10>
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/4.jpg saved to cache
2026-03-24 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be9b10>
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/1.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2ad50>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/3.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/5.jpg not downloaded yet
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/6.jpg not downloaded yet
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/7.jpg not downloaded yet
2026-03-24 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/8.jpg not downloaded yet
2026-03-24 16:46:21 [ayvens.fr] INFO: Found listing with ID: 1980648
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980648%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [ayvens.fr] INFO: Scrape type for 1980648: 1
2026-03-24 16:46:21 [ayvens.fr] INFO: Extracting data for car ID: 1980648
2026-03-24 16:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d4da7a1-539b-5b94-8b44-4ebe4171820b with identifier: 1980648
2026-03-24 16:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b with scrape type 1
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/1.jpg not downloaded yet
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/2.jpg not downloaded yet
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/3.jpg not downloaded yet
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/4.jpg not downloaded yet
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f5710>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F6c12efe7fabd4b25815d34de1ae1954f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/8.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7de1524-c495-514c-bb5f-bb4ea8273cd7
2026-03-24 16:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7de1524-c495-514c-bb5f-bb4ea8273cd7, skipping ID generation
2026-03-24 16:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7de1524-c495-514c-bb5f-bb4ea8273cd7 with scrape type 1
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7de1524-c495-514c-bb5f-bb4ea8273cd7 sending to next pipeline
2026-03-24 16:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a7de1524-c495-514c-bb5f-bb4ea8273cd7, identifier: 1980645
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dc39d0>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/6.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e332d0>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/4.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff450>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/7.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570f790>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/5.jpg saved to cache
2026-03-24 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7eddf90>
2026-03-24 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/2.jpg saved to cache
2026-03-24 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c72d90>
2026-03-24 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/1.jpg saved to cache
2026-03-24 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/5.jpg not downloaded yet
2026-03-24 16:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a7de1524-c495-514c-bb5f-bb4ea8273cd7 with identifier: 1980645
2026-03-24 16:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a7de1524-c495-514c-bb5f-bb4ea8273cd7 with identifier: 1980645
2026-03-24 16:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a7de1524-c495-514c-bb5f-bb4ea8273cd7 with identifier: 1980645 to the API
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'a7de1524-c495-514c-bb5f-bb4ea8273cd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 132487,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7de1524-c495-514c-bb5f-bb4ea8273cd7/a7de1524-c495-514c-bb5f-bb4ea8273cd7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/6c12efe7fabd4b25815d34de1ae1954f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '308 1.5 BlueHDi 130ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980645%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [ayvens.fr] INFO: Saving data for 1980645: {'created_time': 1774370783.085112, 'last_price_update_time': 1774370783.085128, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980645') HTTP/1.1" 204 0
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def150>
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/3.jpg saved to cache
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/6.jpg not downloaded yet
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/7.jpg not downloaded yet
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/8.jpg not downloaded yet
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [ayvens.fr] INFO: Found listing with ID: 1980649
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980649%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [ayvens.fr] INFO: Scrape type for 1980649: 1
2026-03-24 16:46:23 [ayvens.fr] INFO: Extracting data for car ID: 1980649
2026-03-24 16:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b811e9-ca69-54e2-a693-cb8d59fa0231 with identifier: 1980649
2026-03-24 16:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b811e9-ca69-54e2-a693-cb8d59fa0231 with scrape type 1
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/1.jpg not downloaded yet
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/2.jpg not downloaded yet
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/3.jpg not downloaded yet
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def1d0>
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fde6611a2e1d4447e800ef6070b36de05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/8.jpg saved to cache
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0
2026-03-24 16:46:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0, skipping ID generation
2026-03-24 16:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 with scrape type 1
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 sending to next pipeline
2026-03-24 16:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0, identifier: 1980646
2026-03-24 16:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 with identifier: 1980646
2026-03-24 16:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 with identifier: 1980646
2026-03-24 16:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0 with identifier: 1980646 to the API
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-03-24 16:46:23 [crawlers.pipelines.post_to_api] ERROR: ayvens.fr, item_id 47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Color","ErrorMessage":"color value can only be expressed in letters","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 24 Mar 2026 16:46:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-03-24 16:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 127330,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0/47d5351c-e8c2-5bdb-9bd7-ffa9b3a72cd0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/de6611a2e1d4447e800ef6070b36de05/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Business',
'transmission': 'manual',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980646%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [ayvens.fr] INFO: Saving data for 1980646: {'created_time': 1774370783.713325, 'last_price_update_time': 1774370783.713336, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980646') HTTP/1.1" 204 0
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/4.jpg not downloaded yet
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61018d0>
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/5.jpg saved to cache
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/5.jpg not downloaded yet
2026-03-24 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5e510>
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/6.jpg saved to cache
2026-03-24 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bca450>
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/2.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d623d0>
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/4.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5709010>
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/3.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7edde50>
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/7.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5b90>
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/1.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/6.jpg not downloaded yet
2026-03-24 16:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/7.jpg not downloaded yet
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f6450>
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F996115974b4f46eaa7f19cea47e88988%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/8.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f
2026-03-24 16:46:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7c2cb1c-7256-5960-9b3a-e33ca7bd971f, skipping ID generation
2026-03-24 16:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f with scrape type 1
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7c2cb1c-7256-5960-9b3a-e33ca7bd971f sending to next pipeline
2026-03-24 16:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f7c2cb1c-7256-5960-9b3a-e33ca7bd971f, identifier: 1980647
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8950>
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/7.jpg saved to cache
2026-03-24 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f7c2cb1c-7256-5960-9b3a-e33ca7bd971f with identifier: 1980647
2026-03-24 16:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f7c2cb1c-7256-5960-9b3a-e33ca7bd971f with identifier: 1980647
2026-03-24 16:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f7c2cb1c-7256-5960-9b3a-e33ca7bd971f with identifier: 1980647 to the API
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f7c2cb1c-7256-5960-9b3a-e33ca7bd971f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 96221,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c2cb1c-7256-5960-9b3a-e33ca7bd971f/f7c2cb1c-7256-5960-9b3a-e33ca7bd971f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/996115974b4f46eaa7f19cea47e88988/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-02',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2020}
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980647%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [ayvens.fr] INFO: Saving data for 1980647: {'created_time': 1774370785.088597, 'last_price_update_time': 1774370785.088609, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980647') HTTP/1.1" 204 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/8.jpg not downloaded yet
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6125290>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/4.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff890>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/6.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69e90>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/3.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c1010>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/1.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457f290>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/2.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570c350>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/5.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:25 [ayvens.fr] INFO: Found listing with ID: 1980650
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980650%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [ayvens.fr] INFO: Scrape type for 1980650: 1
2026-03-24 16:46:25 [ayvens.fr] INFO: Extracting data for car ID: 1980650
2026-03-24 16:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 771f5ccd-6a53-568f-908c-a7a04f903274 with identifier: 1980650
2026-03-24 16:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 771f5ccd-6a53-568f-908c-a7a04f903274 with scrape type 1
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/1.jpg not downloaded yet
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/2.jpg not downloaded yet
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/3.jpg not downloaded yet
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/4.jpg not downloaded yet
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/5.jpg not downloaded yet
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/6.jpg not downloaded yet
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/7.jpg not downloaded yet
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/8.jpg not downloaded yet
2026-03-24 16:46:25 [ayvens.fr] INFO: Found listing with ID: 1980651
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980651%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [ayvens.fr] INFO: Scrape type for 1980651: 1
2026-03-24 16:46:25 [ayvens.fr] INFO: Extracting data for car ID: 1980651
2026-03-24 16:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53ad236-3f4c-52a7-a232-40db546f01ca with identifier: 1980651
2026-03-24 16:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53ad236-3f4c-52a7-a232-40db546f01ca with scrape type 1
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/1.jpg not downloaded yet
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/2.jpg not downloaded yet
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1f350>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/5.jpg saved to cache
2026-03-24 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e440d0>
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fc092deca22754448871329465d781dde%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/8.jpg saved to cache
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b
2026-03-24 16:46:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d4da7a1-539b-5b94-8b44-4ebe4171820b, skipping ID generation
2026-03-24 16:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b with scrape type 1
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d4da7a1-539b-5b94-8b44-4ebe4171820b sending to next pipeline
2026-03-24 16:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4d4da7a1-539b-5b94-8b44-4ebe4171820b, identifier: 1980648
2026-03-24 16:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4d4da7a1-539b-5b94-8b44-4ebe4171820b with identifier: 1980648
2026-03-24 16:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4d4da7a1-539b-5b94-8b44-4ebe4171820b with identifier: 1980648
2026-03-24 16:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4d4da7a1-539b-5b94-8b44-4ebe4171820b with identifier: 1980648 to the API
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4d4da7a1-539b-5b94-8b44-4ebe4171820b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 50103,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432925,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d4da7a1-539b-5b94-8b44-4ebe4171820b/4d4da7a1-539b-5b94-8b44-4ebe4171820b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/c092deca22754448871329465d781dde/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980648%27 HTTP/1.1" 200 None
2026-03-24 16:46:26 [ayvens.fr] INFO: Saving data for 1980648: {'created_time': 1774370786.630934, 'last_price_update_time': 1774370786.630945, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980648') HTTP/1.1" 204 0
2026-03-24 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/3.jpg not downloaded yet
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724410>
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/1.jpg saved to cache
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4555410>
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/3.jpg saved to cache
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e46c10>
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/2.jpg saved to cache
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c71250>
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/4.jpg saved to cache
2026-03-24 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be89d0>
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/6.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/4.jpg not downloaded yet
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/5.jpg not downloaded yet
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82350>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/7.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/6.jpg not downloaded yet
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/7.jpg not downloaded yet
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666fe90>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/3.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bd610>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/4.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32210>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/6.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/8.jpg not downloaded yet
2026-03-24 16:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:27 [ayvens.fr] INFO: Found listing with ID: 1980652
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980652%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [ayvens.fr] INFO: Scrape type for 1980652: 1
2026-03-24 16:46:27 [ayvens.fr] INFO: Extracting data for car ID: 1980652
2026-03-24 16:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5886b57-31cd-5c45-974a-4aabdb51be71 with identifier: 1980652
2026-03-24 16:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5886b57-31cd-5c45-974a-4aabdb51be71 with scrape type 1
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/1.jpg not downloaded yet
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bac490>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/1.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0c850>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/2.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b62690>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/5.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32410>
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fccd5d42ad06b475780353a8994cf55da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/8.jpg saved to cache
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44b811e9-ca69-54e2-a693-cb8d59fa0231
2026-03-24 16:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44b811e9-ca69-54e2-a693-cb8d59fa0231, skipping ID generation
2026-03-24 16:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b811e9-ca69-54e2-a693-cb8d59fa0231 with scrape type 1
2026-03-24 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44b811e9-ca69-54e2-a693-cb8d59fa0231 sending to next pipeline
2026-03-24 16:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 44b811e9-ca69-54e2-a693-cb8d59fa0231, identifier: 1980649
2026-03-24 16:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 44b811e9-ca69-54e2-a693-cb8d59fa0231 with identifier: 1980649
2026-03-24 16:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 44b811e9-ca69-54e2-a693-cb8d59fa0231 with identifier: 1980649
2026-03-24 16:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 44b811e9-ca69-54e2-a693-cb8d59fa0231 with identifier: 1980649 to the API
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '44b811e9-ca69-54e2-a693-cb8d59fa0231',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 90125,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b811e9-ca69-54e2-a693-cb8d59fa0231/44b811e9-ca69-54e2-a693-cb8d59fa0231_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/ccd5d42ad06b475780353a8994cf55da/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 110ch S&S Allure Business',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 110ch S&S Allure Business',
'vin': None,
'year': 2021}
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980649%27 HTTP/1.1" 200 None
2026-03-24 16:46:28 [ayvens.fr] INFO: Saving data for 1980649: {'created_time': 1774370788.537654, 'last_price_update_time': 1774370788.537668, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980649') HTTP/1.1" 204 0
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/2.jpg not downloaded yet
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/3.jpg not downloaded yet
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cef850>
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/8.jpg saved to cache
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/4.jpg not downloaded yet
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/5.jpg not downloaded yet
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfb550>
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fbd50caadd2a34e59b72b41228a20348c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/7.jpg saved to cache
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 771f5ccd-6a53-568f-908c-a7a04f903274
2026-03-24 16:46:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 771f5ccd-6a53-568f-908c-a7a04f903274, skipping ID generation
2026-03-24 16:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 771f5ccd-6a53-568f-908c-a7a04f903274 with scrape type 1
2026-03-24 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 771f5ccd-6a53-568f-908c-a7a04f903274 sending to next pipeline
2026-03-24 16:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 771f5ccd-6a53-568f-908c-a7a04f903274, identifier: 1980650
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d2d0>
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/5.jpg saved to cache
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7fdd0>
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/3.jpg saved to cache
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c05250>
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/4.jpg saved to cache
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/6.jpg not downloaded yet
2026-03-24 16:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 771f5ccd-6a53-568f-908c-a7a04f903274 with identifier: 1980650
2026-03-24 16:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 771f5ccd-6a53-568f-908c-a7a04f903274 with identifier: 1980650
2026-03-24 16:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 771f5ccd-6a53-568f-908c-a7a04f903274 with identifier: 1980650 to the API
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '771f5ccd-6a53-568f-908c-a7a04f903274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 136534,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336196,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771f5ccd-6a53-568f-908c-a7a04f903274/771f5ccd-6a53-568f-908c-a7a04f903274_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/bd50caadd2a34e59b72b41228a20348c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980650%27 HTTP/1.1" 200 None
2026-03-24 16:46:29 [ayvens.fr] INFO: Saving data for 1980650: {'created_time': 1774370789.915655, 'last_price_update_time': 1774370789.915668, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980650') HTTP/1.1" 204 0
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0cc90>
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/1.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1a1d0>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/2.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/7.jpg not downloaded yet
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61510>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/7.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e457d0>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/6.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/8.jpg not downloaded yet
2026-03-24 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:30 [ayvens.fr] INFO: Found listing with ID: 1980653
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980653%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [ayvens.fr] INFO: Scrape type for 1980653: 1
2026-03-24 16:46:30 [ayvens.fr] INFO: Extracting data for car ID: 1980653
2026-03-24 16:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb067083-2292-500b-90b7-13edc2a18050 with identifier: 1980653
2026-03-24 16:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb067083-2292-500b-90b7-13edc2a18050 with scrape type 1
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/1.jpg not downloaded yet
2026-03-24 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/2.jpg not downloaded yet
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/3.jpg not downloaded yet
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/4.jpg not downloaded yet
2026-03-24 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/5.jpg not downloaded yet
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/6.jpg not downloaded yet
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617ce90>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/3.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfb510>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F798808df72ca459796bd098bec3a095c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/8.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f53ad236-3f4c-52a7-a232-40db546f01ca
2026-03-24 16:46:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f53ad236-3f4c-52a7-a232-40db546f01ca, skipping ID generation
2026-03-24 16:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53ad236-3f4c-52a7-a232-40db546f01ca with scrape type 1
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f53ad236-3f4c-52a7-a232-40db546f01ca sending to next pipeline
2026-03-24 16:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f53ad236-3f4c-52a7-a232-40db546f01ca, identifier: 1980651
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d03cd0>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/1.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456c8d0>
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/2.jpg saved to cache
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/7.jpg not downloaded yet
2026-03-24 16:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f53ad236-3f4c-52a7-a232-40db546f01ca with identifier: 1980651
2026-03-24 16:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f53ad236-3f4c-52a7-a232-40db546f01ca with identifier: 1980651
2026-03-24 16:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f53ad236-3f4c-52a7-a232-40db546f01ca with identifier: 1980651 to the API
2026-03-24 16:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'f53ad236-3f4c-52a7-a232-40db546f01ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 62513,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ad236-3f4c-52a7-a232-40db546f01ca/f53ad236-3f4c-52a7-a232-40db546f01ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/798808df72ca459796bd098bec3a095c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980651%27 HTTP/1.1" 200 None
2026-03-24 16:46:32 [ayvens.fr] INFO: Saving data for 1980651: {'created_time': 1774370792.556066, 'last_price_update_time': 1774370792.556076, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980651') HTTP/1.1" 204 0
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/8.jpg not downloaded yet
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [ayvens.fr] INFO: Found listing with ID: 1980654
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980654%27 HTTP/1.1" 200 None
2026-03-24 16:46:32 [ayvens.fr] INFO: Scrape type for 1980654: 1
2026-03-24 16:46:32 [ayvens.fr] INFO: Extracting data for car ID: 1980654
2026-03-24 16:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3817131b-e83f-518d-a001-20a4ffaf7ce9 with identifier: 1980654
2026-03-24 16:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3817131b-e83f-518d-a001-20a4ffaf7ce9 with scrape type 1
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/1.jpg not downloaded yet
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0cd50>
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/4.jpg saved to cache
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b37d0>
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/5.jpg saved to cache
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/2.jpg not downloaded yet
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/3.jpg not downloaded yet
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19810>
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/6.jpg saved to cache
2026-03-24 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d302d0>
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/8.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/4.jpg not downloaded yet
2026-03-24 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/5.jpg not downloaded yet
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f8d0>
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ffee98ab3b0824f09bb67f47cf96336ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/7.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5886b57-31cd-5c45-974a-4aabdb51be71
2026-03-24 16:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5886b57-31cd-5c45-974a-4aabdb51be71, skipping ID generation
2026-03-24 16:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5886b57-31cd-5c45-974a-4aabdb51be71 with scrape type 1
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5886b57-31cd-5c45-974a-4aabdb51be71 sending to next pipeline
2026-03-24 16:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d5886b57-31cd-5c45-974a-4aabdb51be71, identifier: 1980652
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79e3910>
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/3.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77a90>
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/4.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0fa10>
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/2.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c70990>
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/1.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5709410>
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/5.jpg saved to cache
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/6.jpg not downloaded yet
2026-03-24 16:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d5886b57-31cd-5c45-974a-4aabdb51be71 with identifier: 1980652
2026-03-24 16:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d5886b57-31cd-5c45-974a-4aabdb51be71 with identifier: 1980652
2026-03-24 16:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d5886b57-31cd-5c45-974a-4aabdb51be71 with identifier: 1980652 to the API
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'd5886b57-31cd-5c45-974a-4aabdb51be71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 64986,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302087,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5886b57-31cd-5c45-974a-4aabdb51be71/d5886b57-31cd-5c45-974a-4aabdb51be71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/fee98ab3b0824f09bb67f47cf96336ba/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 1.0 TSI OPF 110ch Life Business',
'transmission': 'manual',
'trim': 'Golf 1.0 TSI OPF 110ch Life Business',
'vin': None,
'year': 2022}
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980652%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [ayvens.fr] INFO: Saving data for 1980652: {'created_time': 1774370794.020681, 'last_price_update_time': 1774370794.020693, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980652') HTTP/1.1" 204 0
2026-03-24 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/7.jpg not downloaded yet
2026-03-24 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c790d0>
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/6.jpg saved to cache
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/8.jpg not downloaded yet
2026-03-24 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:34 [ayvens.fr] INFO: Found listing with ID: 1980655
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980655%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [ayvens.fr] INFO: Scrape type for 1980655: 1
2026-03-24 16:46:34 [ayvens.fr] INFO: Extracting data for car ID: 1980655
2026-03-24 16:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64987cae-b011-5367-90a6-93541daecba6 with identifier: 1980655
2026-03-24 16:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64987cae-b011-5367-90a6-93541daecba6 with scrape type 1
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/1.jpg not downloaded yet
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ebd0>
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/7.jpg saved to cache
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050f90>
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4756e1cfa59b41d7b345bae283a8b914%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/8.jpg saved to cache
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb067083-2292-500b-90b7-13edc2a18050
2026-03-24 16:46:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb067083-2292-500b-90b7-13edc2a18050, skipping ID generation
2026-03-24 16:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb067083-2292-500b-90b7-13edc2a18050 with scrape type 1
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb067083-2292-500b-90b7-13edc2a18050 sending to next pipeline
2026-03-24 16:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bb067083-2292-500b-90b7-13edc2a18050, identifier: 1980653
2026-03-24 16:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bb067083-2292-500b-90b7-13edc2a18050 with identifier: 1980653
2026-03-24 16:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bb067083-2292-500b-90b7-13edc2a18050 with identifier: 1980653
2026-03-24 16:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bb067083-2292-500b-90b7-13edc2a18050 with identifier: 1980653 to the API
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'bb067083-2292-500b-90b7-13edc2a18050',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 56855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb067083-2292-500b-90b7-13edc2a18050/bb067083-2292-500b-90b7-13edc2a18050_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4756e1cfa59b41d7b345bae283a8b914/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-17',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980653%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [ayvens.fr] INFO: Saving data for 1980653: {'created_time': 1774370794.918925, 'last_price_update_time': 1774370794.918937, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980653') HTTP/1.1" 204 0
2026-03-24 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/2.jpg not downloaded yet
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613df90>
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/1.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56bc210>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/3.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/3.jpg not downloaded yet
2026-03-24 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/4.jpg not downloaded yet
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ed750>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/2.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/5.jpg not downloaded yet
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/6.jpg not downloaded yet
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/7.jpg not downloaded yet
2026-03-24 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e065d0>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/4.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd71d0>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/7.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/8.jpg not downloaded yet
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cae750>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/5.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611ae90>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/6.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [ayvens.fr] INFO: Found listing with ID: 1980656
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980656%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [ayvens.fr] INFO: Scrape type for 1980656: 1
2026-03-24 16:46:35 [ayvens.fr] INFO: Extracting data for car ID: 1980656
2026-03-24 16:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ccb9823-799b-55f1-b298-d917ae64b6ec with identifier: 1980656
2026-03-24 16:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccb9823-799b-55f1-b298-d917ae64b6ec with scrape type 1
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/1.jpg not downloaded yet
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0b450>
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F488a88dea51845aa944a8cc8caeb1e46%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/8.jpg saved to cache
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3817131b-e83f-518d-a001-20a4ffaf7ce9
2026-03-24 16:46:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3817131b-e83f-518d-a001-20a4ffaf7ce9, skipping ID generation
2026-03-24 16:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3817131b-e83f-518d-a001-20a4ffaf7ce9 with scrape type 1
2026-03-24 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3817131b-e83f-518d-a001-20a4ffaf7ce9 sending to next pipeline
2026-03-24 16:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3817131b-e83f-518d-a001-20a4ffaf7ce9, identifier: 1980654
2026-03-24 16:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3817131b-e83f-518d-a001-20a4ffaf7ce9 with identifier: 1980654
2026-03-24 16:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3817131b-e83f-518d-a001-20a4ffaf7ce9 with identifier: 1980654
2026-03-24 16:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3817131b-e83f-518d-a001-20a4ffaf7ce9 with identifier: 1980654 to the API
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '3817131b-e83f-518d-a001-20a4ffaf7ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 62739,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3817131b-e83f-518d-a001-20a4ffaf7ce9/3817131b-e83f-518d-a001-20a4ffaf7ce9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/488a88dea51845aa944a8cc8caeb1e46/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance Business',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance Business',
'vin': None,
'year': 2023}
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980654%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [ayvens.fr] INFO: Saving data for 1980654: {'created_time': 1774370796.357031, 'last_price_update_time': 1774370796.357043, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980654') HTTP/1.1" 204 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/2.jpg not downloaded yet
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/3.jpg not downloaded yet
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/4.jpg not downloaded yet
2026-03-24 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/5.jpg not downloaded yet
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/6.jpg not downloaded yet
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/7.jpg not downloaded yet
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/8.jpg not downloaded yet
2026-03-24 16:46:36 [ayvens.fr] INFO: Found listing with ID: 1980657
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980657%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [ayvens.fr] INFO: Scrape type for 1980657: 1
2026-03-24 16:46:36 [ayvens.fr] INFO: Extracting data for car ID: 1980657
2026-03-24 16:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0b2be90-c34b-54a7-8a49-8adb358d95c1 with identifier: 1980657
2026-03-24 16:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0b2be90-c34b-54a7-8a49-8adb358d95c1 with scrape type 1
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/1.jpg not downloaded yet
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/2.jpg not downloaded yet
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60d90>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/2.jpg saved to cache
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c832d0>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/1.jpg saved to cache
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7ceebd0>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/3.jpg saved to cache
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/3.jpg not downloaded yet
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605bb50>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/4.jpg saved to cache
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611b950>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/5.jpg saved to cache
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cafbd0>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/7.jpg saved to cache
2026-03-24 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b76c50>
2026-03-24 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/6.jpg saved to cache
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/4.jpg not downloaded yet
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/5.jpg not downloaded yet
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/6.jpg not downloaded yet
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/7.jpg not downloaded yet
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/8.jpg not downloaded yet
2026-03-24 16:46:37 [ayvens.fr] INFO: Found listing with ID: 1980658
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980658%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [ayvens.fr] INFO: Scrape type for 1980658: 1
2026-03-24 16:46:37 [ayvens.fr] INFO: Extracting data for car ID: 1980658
2026-03-24 16:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 with identifier: 1980658
2026-03-24 16:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 with scrape type 1
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/1.jpg not downloaded yet
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/2.jpg not downloaded yet
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc7490>
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fb4de09f81676449f81f5dc5e570ca614%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/8.jpg saved to cache
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64987cae-b011-5367-90a6-93541daecba6
2026-03-24 16:46:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64987cae-b011-5367-90a6-93541daecba6, skipping ID generation
2026-03-24 16:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64987cae-b011-5367-90a6-93541daecba6 with scrape type 1
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64987cae-b011-5367-90a6-93541daecba6 sending to next pipeline
2026-03-24 16:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 64987cae-b011-5367-90a6-93541daecba6, identifier: 1980655
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/3.jpg not downloaded yet
2026-03-24 16:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 64987cae-b011-5367-90a6-93541daecba6 with identifier: 1980655
2026-03-24 16:46:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 64987cae-b011-5367-90a6-93541daecba6 with identifier: 1980655
2026-03-24 16:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 64987cae-b011-5367-90a6-93541daecba6 with identifier: 1980655 to the API
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '64987cae-b011-5367-90a6-93541daecba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 96118,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64987cae-b011-5367-90a6-93541daecba6/64987cae-b011-5367-90a6-93541daecba6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/b4de09f81676449f81f5dc5e570ca614/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L1H1 1200 2.0 dCi 120ch Grand Confort',
'transmission': 'manual',
'trim': 'Trafic Fg L1H1 1200 2.0 dCi 120ch Grand Confort',
'vin': None,
'year': 2019}
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980655%27 HTTP/1.1" 200 None
2026-03-24 16:46:37 [ayvens.fr] INFO: Saving data for 1980655: {'created_time': 1774370797.807428, 'last_price_update_time': 1774370797.80744, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980655') HTTP/1.1" 204 0
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8350>
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/6.jpg saved to cache
2026-03-24 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d13d0>
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/7.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/4.jpg not downloaded yet
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bc250>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/1.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5cd50>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/4.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d023d0>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/5.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708290>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/3.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bd410>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/2.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/5.jpg not downloaded yet
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/6.jpg not downloaded yet
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/7.jpg not downloaded yet
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/8.jpg not downloaded yet
2026-03-24 16:46:38 [ayvens.fr] INFO: Found listing with ID: 1980659
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980659%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [ayvens.fr] INFO: Scrape type for 1980659: 1
2026-03-24 16:46:38 [ayvens.fr] INFO: Extracting data for car ID: 1980659
2026-03-24 16:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70b13c8-899e-5d75-952b-e58b4fb8d158 with identifier: 1980659
2026-03-24 16:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70b13c8-899e-5d75-952b-e58b4fb8d158 with scrape type 1
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/1.jpg not downloaded yet
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/2.jpg not downloaded yet
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d9d0>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/1.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b3590>
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe4aa46ae899249878f2b72d639500791%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/8.jpg saved to cache
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ccb9823-799b-55f1-b298-d917ae64b6ec
2026-03-24 16:46:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ccb9823-799b-55f1-b298-d917ae64b6ec, skipping ID generation
2026-03-24 16:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccb9823-799b-55f1-b298-d917ae64b6ec with scrape type 1
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ccb9823-799b-55f1-b298-d917ae64b6ec sending to next pipeline
2026-03-24 16:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3ccb9823-799b-55f1-b298-d917ae64b6ec, identifier: 1980656
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/3.jpg not downloaded yet
2026-03-24 16:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3ccb9823-799b-55f1-b298-d917ae64b6ec with identifier: 1980656
2026-03-24 16:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3ccb9823-799b-55f1-b298-d917ae64b6ec with identifier: 1980656
2026-03-24 16:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3ccb9823-799b-55f1-b298-d917ae64b6ec with identifier: 1980656 to the API
2026-03-24 16:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '3ccb9823-799b-55f1-b298-d917ae64b6ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'E-TRANSIT',
'odometer': 52735,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356349,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279907,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316576,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb9823-799b-55f1-b298-d917ae64b6ec/3ccb9823-799b-55f1-b298-d917ae64b6ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e4aa46ae899249878f2b72d639500791/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-31',
'seats_number': 3,
'seller_name': None,
'title': 'FORD E-TRANSIT Transit 2T Fg PE 350 L2H2 135 kW Batterie 75/68 kWh '
'Trend Business // - 3T9 VITESSE LIMITEE A 90//OK PERMIS B',
'transmission': 'automatic',
'trim': 'Transit 2T Fg PE 350 L2H2 135 kW Batterie 75/68 kWh Trend Business '
'// - 3T9 VITESSE LIMITEE A 90//OK PERMIS B',
'vin': None,
'year': 2023}
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980656%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [ayvens.fr] INFO: Saving data for 1980656: {'created_time': 1774370799.157993, 'last_price_update_time': 1774370799.158004, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980656') HTTP/1.1" 204 0
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0a810>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/5.jpg saved to cache
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fe210>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/4.jpg saved to cache
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e819e2d0>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/3.jpg saved to cache
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf6350>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/6.jpg saved to cache
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d4690>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/7.jpg saved to cache
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572c810>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/2.jpg saved to cache
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/4.jpg not downloaded yet
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/5.jpg not downloaded yet
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/6.jpg not downloaded yet
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/7.jpg not downloaded yet
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/8.jpg not downloaded yet
2026-03-24 16:46:39 [ayvens.fr] INFO: Found listing with ID: 1980660
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980660%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [ayvens.fr] INFO: Scrape type for 1980660: 1
2026-03-24 16:46:39 [ayvens.fr] INFO: Extracting data for car ID: 1980660
2026-03-24 16:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a with identifier: 1980660
2026-03-24 16:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a with scrape type 1
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/1.jpg not downloaded yet
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/2.jpg not downloaded yet
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570b410>
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/1.jpg saved to cache
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4577e50>
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/5.jpg saved to cache
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/3.jpg not downloaded yet
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2950>
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/4.jpg saved to cache
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ec650>
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/2.jpg saved to cache
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726750>
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcda84c457d3e4611946691c1bedf23b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/8.jpg saved to cache
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0b2be90-c34b-54a7-8a49-8adb358d95c1
2026-03-24 16:46:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0b2be90-c34b-54a7-8a49-8adb358d95c1, skipping ID generation
2026-03-24 16:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0b2be90-c34b-54a7-8a49-8adb358d95c1 with scrape type 1
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0b2be90-c34b-54a7-8a49-8adb358d95c1 sending to next pipeline
2026-03-24 16:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a0b2be90-c34b-54a7-8a49-8adb358d95c1, identifier: 1980657
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e88637d0>
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/6.jpg saved to cache
2026-03-24 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a0b2be90-c34b-54a7-8a49-8adb358d95c1 with identifier: 1980657
2026-03-24 16:46:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a0b2be90-c34b-54a7-8a49-8adb358d95c1 with identifier: 1980657
2026-03-24 16:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a0b2be90-c34b-54a7-8a49-8adb358d95c1 with identifier: 1980657 to the API
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'ALPIWEISS UNI BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'a0b2be90-c34b-54a7-8a49-8adb358d95c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 72690,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0b2be90-c34b-54a7-8a49-8adb358d95c1/a0b2be90-c34b-54a7-8a49-8adb358d95c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cda84c457d3e4611946691c1bedf23b5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch Business Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch Business Design DKG7',
'vin': None,
'year': 2023}
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980657%27 HTTP/1.1" 200 None
2026-03-24 16:46:40 [ayvens.fr] INFO: Saving data for 1980657: {'created_time': 1774370800.97063, 'last_price_update_time': 1774370800.970642, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980657') HTTP/1.1" 204 0
2026-03-24 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/4.jpg not downloaded yet
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d11cd0>
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/7.jpg saved to cache
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c615d0>
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/3.jpg saved to cache
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd41d0>
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F5dd0a041e2bf4cda825ddc2e6de6754b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/8.jpg saved to cache
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281
2026-03-24 16:46:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f8722d5-8b5f-5bd4-9a7f-626a2b360281, skipping ID generation
2026-03-24 16:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 with scrape type 1
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 sending to next pipeline
2026-03-24 16:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9f8722d5-8b5f-5bd4-9a7f-626a2b360281, identifier: 1980658
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/5.jpg not downloaded yet
2026-03-24 16:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 with identifier: 1980658
2026-03-24 16:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 with identifier: 1980658
2026-03-24 16:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9f8722d5-8b5f-5bd4-9a7f-626a2b360281 with identifier: 1980658 to the API
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '9f8722d5-8b5f-5bd4-9a7f-626a2b360281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 70937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307925,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8722d5-8b5f-5bd4-9a7f-626a2b360281/9f8722d5-8b5f-5bd4-9a7f-626a2b360281_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/5dd0a041e2bf4cda825ddc2e6de6754b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV GT-line Premium Business '
'BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV GT-line Premium Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980658%27 HTTP/1.1" 200 None
2026-03-24 16:46:41 [ayvens.fr] INFO: Saving data for 1980658: {'created_time': 1774370801.927954, 'last_price_update_time': 1774370801.927967, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980658') HTTP/1.1" 204 0
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/6.jpg not downloaded yet
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e883e1d0>
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/2.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7f190>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/4.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da7610>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/5.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e45690>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/7.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/7.jpg not downloaded yet
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/8.jpg not downloaded yet
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7c6d0>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/1.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d10050>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/3.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7fd0>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/6.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [ayvens.fr] INFO: Found listing with ID: 1980661
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980661%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [ayvens.fr] INFO: Scrape type for 1980661: 1
2026-03-24 16:46:42 [ayvens.fr] INFO: Extracting data for car ID: 1980661
2026-03-24 16:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627705f0-652a-5c75-b4a3-80a52895cfe4 with identifier: 1980661
2026-03-24 16:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627705f0-652a-5c75-b4a3-80a52895cfe4 with scrape type 1
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/1.jpg not downloaded yet
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/2.jpg not downloaded yet
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/3.jpg not downloaded yet
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/4.jpg not downloaded yet
2026-03-24 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/5.jpg not downloaded yet
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/6.jpg not downloaded yet
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6a5d0>
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F68d48b3a0e374c51bd8bd3ed1e173b89%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/8.jpg saved to cache
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b70b13c8-899e-5d75-952b-e58b4fb8d158
2026-03-24 16:46:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b70b13c8-899e-5d75-952b-e58b4fb8d158, skipping ID generation
2026-03-24 16:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70b13c8-899e-5d75-952b-e58b4fb8d158 with scrape type 1
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b70b13c8-899e-5d75-952b-e58b4fb8d158 sending to next pipeline
2026-03-24 16:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b70b13c8-899e-5d75-952b-e58b4fb8d158, identifier: 1980659
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/7.jpg not downloaded yet
2026-03-24 16:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b70b13c8-899e-5d75-952b-e58b4fb8d158 with identifier: 1980659
2026-03-24 16:46:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b70b13c8-899e-5d75-952b-e58b4fb8d158 with identifier: 1980659
2026-03-24 16:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b70b13c8-899e-5d75-952b-e58b4fb8d158 with identifier: 1980659 to the API
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'SAPHIR SCHWARZ METAL NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'b70b13c8-899e-5d75-952b-e58b4fb8d158',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 67486,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70b13c8-899e-5d75-952b-e58b4fb8d158/b70b13c8-899e-5d75-952b-e58b4fb8d158_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/68d48b3a0e374c51bd8bd3ed1e173b89/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Série 1 118iA 136ch Edition Sport DKG7',
'transmission': 'automatic',
'trim': 'Série 1 118iA 136ch Edition Sport DKG7',
'vin': None,
'year': 2023}
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980659%27 HTTP/1.1" 200 None
2026-03-24 16:46:43 [ayvens.fr] INFO: Saving data for 1980659: {'created_time': 1774370803.500651, 'last_price_update_time': 1774370803.500663, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980659') HTTP/1.1" 204 0
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/8.jpg not downloaded yet
2026-03-24 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b74150>
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/2.jpg saved to cache
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45ab2d0>
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/1.jpg saved to cache
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45578d0>
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/3.jpg saved to cache
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6059410>
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/4.jpg saved to cache
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457e1d0>
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/6.jpg saved to cache
2026-03-24 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75c50>
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/5.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [ayvens.fr] INFO: Found listing with ID: 1980662
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980662%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [ayvens.fr] INFO: Scrape type for 1980662: 1
2026-03-24 16:46:44 [ayvens.fr] INFO: Extracting data for car ID: 1980662
2026-03-24 16:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d93271e-f8f4-5b57-9826-28309194137c with identifier: 1980662
2026-03-24 16:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d93271e-f8f4-5b57-9826-28309194137c with scrape type 1
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/1.jpg not downloaded yet
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/2.jpg not downloaded yet
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3f050>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/8.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/3.jpg not downloaded yet
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/4.jpg not downloaded yet
2026-03-24 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d70250>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/4.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2d10>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/2.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7c990>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/3.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bad10>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/1.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/5.jpg not downloaded yet
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/6.jpg not downloaded yet
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7e550>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0d343650f5f8400592c2e400eae4d203%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/7.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a
2026-03-24 16:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a, skipping ID generation
2026-03-24 16:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a with scrape type 1
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a sending to next pipeline
2026-03-24 16:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a, identifier: 1980660
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8306c90>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/6.jpg saved to cache
2026-03-24 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d31e50>
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/5.jpg saved to cache
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a8810>
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/7.jpg saved to cache
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a with identifier: 1980660
2026-03-24 16:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a with identifier: 1980660
2026-03-24 16:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a with identifier: 1980660 to the API
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 19933,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422709,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305236,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a/cb2dc6d0-5c8f-50e4-9d52-c4311e85d53a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0d343650f5f8400592c2e400eae4d203/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-21',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980660%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [ayvens.fr] INFO: Saving data for 1980660: {'created_time': 1774370805.423588, 'last_price_update_time': 1774370805.423603, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980660') HTTP/1.1" 204 0
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/7.jpg not downloaded yet
2026-03-24 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/8.jpg not downloaded yet
2026-03-24 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:45 [ayvens.fr] INFO: Found listing with ID: 1980663
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980663%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [ayvens.fr] INFO: Scrape type for 1980663: 1
2026-03-24 16:46:45 [ayvens.fr] INFO: Extracting data for car ID: 1980663
2026-03-24 16:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12173c1-1e47-54b1-9151-479749d1a6f0 with identifier: 1980663
2026-03-24 16:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12173c1-1e47-54b1-9151-479749d1a6f0 with scrape type 1
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/1.jpg not downloaded yet
2026-03-24 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/2.jpg not downloaded yet
2026-03-24 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/3.jpg not downloaded yet
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dfcd10>
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3ee15fef5c1d4d33bb598fcad34b0431%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/8.jpg saved to cache
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 627705f0-652a-5c75-b4a3-80a52895cfe4
2026-03-24 16:46:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 627705f0-652a-5c75-b4a3-80a52895cfe4, skipping ID generation
2026-03-24 16:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627705f0-652a-5c75-b4a3-80a52895cfe4 with scrape type 1
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 627705f0-652a-5c75-b4a3-80a52895cfe4 sending to next pipeline
2026-03-24 16:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 627705f0-652a-5c75-b4a3-80a52895cfe4, identifier: 1980661
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8a10>
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/4.jpg saved to cache
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/4.jpg not downloaded yet
2026-03-24 16:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 627705f0-652a-5c75-b4a3-80a52895cfe4 with identifier: 1980661
2026-03-24 16:46:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 627705f0-652a-5c75-b4a3-80a52895cfe4 with identifier: 1980661
2026-03-24 16:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 627705f0-652a-5c75-b4a3-80a52895cfe4 with identifier: 1980661 to the API
2026-03-24 16:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 28,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '627705f0-652a-5c75-b4a3-80a52895cfe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 120810,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256746,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_627705f0-652a-5c75-b4a3-80a52895cfe4/627705f0-652a-5c75-b4a3-80a52895cfe4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3ee15fef5c1d4d33bb598fcad34b0431/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 Plug-in Hybrid 225ch Allure Pack e-EAT8',
'transmission': 'automatic',
'trim': '3008 Plug-in Hybrid 225ch Allure Pack e-EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980661%27 HTTP/1.1" 200 None
2026-03-24 16:46:46 [ayvens.fr] INFO: Saving data for 1980661: {'created_time': 1774370806.530586, 'last_price_update_time': 1774370806.5306, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980661') HTTP/1.1" 204 0
2026-03-24 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/5.jpg not downloaded yet
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60514d0>
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/2.jpg saved to cache
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4fc10>
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/1.jpg saved to cache
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c73590>
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/3.jpg saved to cache
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d98110>
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/7.jpg saved to cache
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/6.jpg not downloaded yet
2026-03-24 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3cf90>
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/5.jpg saved to cache
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b85710>
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/6.jpg saved to cache
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/7.jpg not downloaded yet
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/8.jpg not downloaded yet
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c68090>
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Feaf98ae6057f44faa8473c9cc06fb28c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/8.jpg saved to cache
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d93271e-f8f4-5b57-9826-28309194137c
2026-03-24 16:46:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d93271e-f8f4-5b57-9826-28309194137c, skipping ID generation
2026-03-24 16:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d93271e-f8f4-5b57-9826-28309194137c with scrape type 1
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d93271e-f8f4-5b57-9826-28309194137c sending to next pipeline
2026-03-24 16:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7d93271e-f8f4-5b57-9826-28309194137c, identifier: 1980662
2026-03-24 16:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7d93271e-f8f4-5b57-9826-28309194137c with identifier: 1980662
2026-03-24 16:46:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7d93271e-f8f4-5b57-9826-28309194137c with identifier: 1980662
2026-03-24 16:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7d93271e-f8f4-5b57-9826-28309194137c with identifier: 1980662 to the API
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'GRIS AMAZONITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '7d93271e-f8f4-5b57-9826-28309194137c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 64625,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d93271e-f8f4-5b57-9826-28309194137c/7d93271e-f8f4-5b57-9826-28309194137c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/eaf98ae6057f44faa8473c9cc06fb28c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-04',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Allure Business',
'transmission': 'manual',
'trim': '5008 1.2 PureTech 130ch S&S Allure Business',
'vin': None,
'year': 2019}
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980662%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [ayvens.fr] INFO: Saving data for 1980662: {'created_time': 1774370807.66838, 'last_price_update_time': 1774370807.668394, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980662') HTTP/1.1" 204 0
2026-03-24 16:46:47 [ayvens.fr] INFO: Found listing with ID: 1980664
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980664%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [ayvens.fr] INFO: Scrape type for 1980664: 1
2026-03-24 16:46:47 [ayvens.fr] INFO: Extracting data for car ID: 1980664
2026-03-24 16:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0dbfebf-c017-5a84-96a2-5346851504ff with identifier: 1980664
2026-03-24 16:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0dbfebf-c017-5a84-96a2-5346851504ff with scrape type 1
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/1.jpg not downloaded yet
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/2.jpg not downloaded yet
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/3.jpg not downloaded yet
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/4.jpg not downloaded yet
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/5.jpg not downloaded yet
2026-03-24 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/6.jpg not downloaded yet
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/7.jpg not downloaded yet
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/8.jpg not downloaded yet
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b85f10>
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/1.jpg saved to cache
2026-03-24 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fff50>
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/3.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [ayvens.fr] INFO: Found listing with ID: 1980665
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980665%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [ayvens.fr] INFO: Scrape type for 1980665: 1
2026-03-24 16:46:48 [ayvens.fr] INFO: Extracting data for car ID: 1980665
2026-03-24 16:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1140b23-fb9e-5b33-b520-aa5cd18129d9 with identifier: 1980665
2026-03-24 16:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1140b23-fb9e-5b33-b520-aa5cd18129d9 with scrape type 1
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/1.jpg not downloaded yet
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570f850>
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/4.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571b9d0>
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/2.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/2.jpg not downloaded yet
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/3.jpg not downloaded yet
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c808d0>
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/5.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79f9fd0>
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/6.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e3910>
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/7.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/4.jpg not downloaded yet
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/5.jpg not downloaded yet
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd36d0>
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc4963ce766a24d1f82b1ee755a105d2f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/8.jpg saved to cache
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c12173c1-1e47-54b1-9151-479749d1a6f0
2026-03-24 16:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c12173c1-1e47-54b1-9151-479749d1a6f0, skipping ID generation
2026-03-24 16:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12173c1-1e47-54b1-9151-479749d1a6f0 with scrape type 1
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c12173c1-1e47-54b1-9151-479749d1a6f0 sending to next pipeline
2026-03-24 16:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c12173c1-1e47-54b1-9151-479749d1a6f0, identifier: 1980663
2026-03-24 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/6.jpg not downloaded yet
2026-03-24 16:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c12173c1-1e47-54b1-9151-479749d1a6f0 with identifier: 1980663
2026-03-24 16:46:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c12173c1-1e47-54b1-9151-479749d1a6f0 with identifier: 1980663
2026-03-24 16:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c12173c1-1e47-54b1-9151-479749d1a6f0 with identifier: 1980663 to the API
2026-03-24 16:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'GRIS INDIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c12173c1-1e47-54b1-9151-479749d1a6f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'T-ROC',
'odometer': 127656,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12173c1-1e47-54b1-9151-479749d1a6f0/c12173c1-1e47-54b1-9151-479749d1a6f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c4963ce766a24d1f82b1ee755a105d2f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN T-ROC T-Roc 2.0 TDI 150ch Lounge Business DSG7',
'transmission': 'automatic',
'trim': 'T-Roc 2.0 TDI 150ch Lounge Business DSG7',
'vin': None,
'year': 2021}
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980663%27 HTTP/1.1" 200 None
2026-03-24 16:46:49 [ayvens.fr] INFO: Saving data for 1980663: {'created_time': 1774370809.533426, 'last_price_update_time': 1774370809.533438, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980663') HTTP/1.1" 204 0
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb650>
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/6.jpg saved to cache
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/7.jpg not downloaded yet
2026-03-24 16:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f6a50>
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/2.jpg saved to cache
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8290>
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/4.jpg saved to cache
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3c8d0>
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/5.jpg saved to cache
2026-03-24 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba1110>
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/1.jpg saved to cache
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6145210>
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/3.jpg saved to cache
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ab210>
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/7.jpg saved to cache
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/8.jpg not downloaded yet
2026-03-24 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:50 [ayvens.fr] INFO: Found listing with ID: 1980666
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980666%27 HTTP/1.1" 200 None
2026-03-24 16:46:50 [ayvens.fr] INFO: Scrape type for 1980666: 1
2026-03-24 16:46:50 [ayvens.fr] INFO: Extracting data for car ID: 1980666
2026-03-24 16:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1379b9a-2ed5-520e-b1d0-86d603099e51 with identifier: 1980666
2026-03-24 16:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1379b9a-2ed5-520e-b1d0-86d603099e51 with scrape type 1
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/1.jpg not downloaded yet
2026-03-24 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726490>
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F538c59a6936d4ccf8ceeccb04e4c1dad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/8.jpg saved to cache
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0dbfebf-c017-5a84-96a2-5346851504ff
2026-03-24 16:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0dbfebf-c017-5a84-96a2-5346851504ff, skipping ID generation
2026-03-24 16:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0dbfebf-c017-5a84-96a2-5346851504ff with scrape type 1
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0dbfebf-c017-5a84-96a2-5346851504ff sending to next pipeline
2026-03-24 16:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d0dbfebf-c017-5a84-96a2-5346851504ff, identifier: 1980664
2026-03-24 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/2.jpg not downloaded yet
2026-03-24 16:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d0dbfebf-c017-5a84-96a2-5346851504ff with identifier: 1980664
2026-03-24 16:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d0dbfebf-c017-5a84-96a2-5346851504ff with identifier: 1980664
2026-03-24 16:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d0dbfebf-c017-5a84-96a2-5346851504ff with identifier: 1980664 to the API
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd0dbfebf-c017-5a84-96a2-5346851504ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 21803,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0dbfebf-c017-5a84-96a2-5346851504ff/d0dbfebf-c017-5a84-96a2-5346851504ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/538c59a6936d4ccf8ceeccb04e4c1dad/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-21',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980664%27 HTTP/1.1" 200 None
2026-03-24 16:46:50 [ayvens.fr] INFO: Saving data for 1980664: {'created_time': 1774370810.872241, 'last_price_update_time': 1774370810.872252, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980664') HTTP/1.1" 204 0
2026-03-24 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/3.jpg not downloaded yet
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725e10>
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/1.jpg saved to cache
2026-03-24 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bdfd0>
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/2.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7f290>
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/3.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/4.jpg not downloaded yet
2026-03-24 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/5.jpg not downloaded yet
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e06c10>
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/4.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e45350>
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/5.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/6.jpg not downloaded yet
2026-03-24 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/7.jpg not downloaded yet
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4550>
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/7.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07ad0>
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/6.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/8.jpg not downloaded yet
2026-03-24 16:46:51 [ayvens.fr] INFO: Found listing with ID: 1980667
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980667%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [ayvens.fr] INFO: Scrape type for 1980667: 1
2026-03-24 16:46:51 [ayvens.fr] INFO: Extracting data for car ID: 1980667
2026-03-24 16:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64ddf43-71d6-5dfc-966c-e821eba34923 with identifier: 1980667
2026-03-24 16:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64ddf43-71d6-5dfc-966c-e821eba34923 with scrape type 1
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/1.jpg not downloaded yet
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcfb10>
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F25b972b7200844a1af241e5308ec607c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/8.jpg saved to cache
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1140b23-fb9e-5b33-b520-aa5cd18129d9
2026-03-24 16:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1140b23-fb9e-5b33-b520-aa5cd18129d9, skipping ID generation
2026-03-24 16:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1140b23-fb9e-5b33-b520-aa5cd18129d9 with scrape type 1
2026-03-24 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1140b23-fb9e-5b33-b520-aa5cd18129d9 sending to next pipeline
2026-03-24 16:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b1140b23-fb9e-5b33-b520-aa5cd18129d9, identifier: 1980665
2026-03-24 16:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b1140b23-fb9e-5b33-b520-aa5cd18129d9 with identifier: 1980665
2026-03-24 16:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b1140b23-fb9e-5b33-b520-aa5cd18129d9 with identifier: 1980665
2026-03-24 16:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b1140b23-fb9e-5b33-b520-aa5cd18129d9 with identifier: 1980665 to the API
2026-03-24 16:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 176,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b1140b23-fb9e-5b33-b520-aa5cd18129d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 124838,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312606,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312790,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1140b23-fb9e-5b33-b520-aa5cd18129d9/b1140b23-fb9e-5b33-b520-aa5cd18129d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/25b972b7200844a1af241e5308ec607c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-04',
'seats_number': 7,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE Tiguan Allspace 2.0 TDI 150ch Carat '
'Exclusive 4Motion DSG7',
'transmission': 'automatic',
'trim': 'Tiguan Allspace 2.0 TDI 150ch Carat Exclusive 4Motion DSG7',
'vin': None,
'year': 2020}
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980665%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [ayvens.fr] INFO: Saving data for 1980665: {'created_time': 1774370812.158481, 'last_price_update_time': 1774370812.158492, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980665') HTTP/1.1" 204 0
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/2.jpg not downloaded yet
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bcc50>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/1.jpg saved to cache
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/3.jpg not downloaded yet
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/4.jpg not downloaded yet
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666fa50>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/3.jpg saved to cache
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e82d8110>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/2.jpg saved to cache
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/5.jpg not downloaded yet
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/6.jpg not downloaded yet
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459dc10>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/5.jpg saved to cache
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcf790>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/7.jpg saved to cache
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2990>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/6.jpg saved to cache
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/7.jpg not downloaded yet
2026-03-24 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/8.jpg not downloaded yet
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e06150>
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/4.jpg saved to cache
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:53 [ayvens.fr] INFO: Found listing with ID: 1980668
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980668%27 HTTP/1.1" 200 None
2026-03-24 16:46:53 [ayvens.fr] INFO: Scrape type for 1980668: 1
2026-03-24 16:46:53 [ayvens.fr] INFO: Extracting data for car ID: 1980668
2026-03-24 16:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0933b3f-9655-5553-8eda-72f794e42b62 with identifier: 1980668
2026-03-24 16:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0933b3f-9655-5553-8eda-72f794e42b62 with scrape type 1
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/1.jpg not downloaded yet
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/2.jpg not downloaded yet
2026-03-24 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddc190>
2026-03-24 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffeecf42f5efd4549a5e9c37d16ebef90%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/8.jpg saved to cache
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1379b9a-2ed5-520e-b1d0-86d603099e51
2026-03-24 16:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1379b9a-2ed5-520e-b1d0-86d603099e51, skipping ID generation
2026-03-24 16:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1379b9a-2ed5-520e-b1d0-86d603099e51 with scrape type 1
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1379b9a-2ed5-520e-b1d0-86d603099e51 sending to next pipeline
2026-03-24 16:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b1379b9a-2ed5-520e-b1d0-86d603099e51, identifier: 1980666
2026-03-24 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/3.jpg not downloaded yet
2026-03-24 16:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b1379b9a-2ed5-520e-b1d0-86d603099e51 with identifier: 1980666
2026-03-24 16:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b1379b9a-2ed5-520e-b1d0-86d603099e51 with identifier: 1980666
2026-03-24 16:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b1379b9a-2ed5-520e-b1d0-86d603099e51 with identifier: 1980666 to the API
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b1379b9a-2ed5-520e-b1d0-86d603099e51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 97343,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463831,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463831,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486782,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1379b9a-2ed5-520e-b1d0-86d603099e51/b1379b9a-2ed5-520e-b1d0-86d603099e51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/feecf42f5efd4549a5e9c37d16ebef90/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-05',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'vin': None,
'year': 2019}
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980666%27 HTTP/1.1" 200 None
2026-03-24 16:46:53 [ayvens.fr] INFO: Saving data for 1980666: {'created_time': 1774370813.959839, 'last_price_update_time': 1774370813.959851, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980666') HTTP/1.1" 204 0
2026-03-24 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/4.jpg not downloaded yet
2026-03-24 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4556410>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/1.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725b90>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/2.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4599950>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/3.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454d6d0>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/4.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/5.jpg not downloaded yet
2026-03-24 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/6.jpg not downloaded yet
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459b290>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/5.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d86010>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/6.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/7.jpg not downloaded yet
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/8.jpg not downloaded yet
2026-03-24 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dedd10>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/7.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [ayvens.fr] INFO: Found listing with ID: 1980669
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980669%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [ayvens.fr] INFO: Scrape type for 1980669: 1
2026-03-24 16:46:54 [ayvens.fr] INFO: Extracting data for car ID: 1980669
2026-03-24 16:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee09534d-7d87-58a9-9146-e4a62fc077ca with identifier: 1980669
2026-03-24 16:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee09534d-7d87-58a9-9146-e4a62fc077ca with scrape type 1
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/1.jpg not downloaded yet
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/2.jpg not downloaded yet
2026-03-24 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457d2d0>
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fb8a5eb478d2b4c78a7755ff984acc2d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/8.jpg saved to cache
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c64ddf43-71d6-5dfc-966c-e821eba34923
2026-03-24 16:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c64ddf43-71d6-5dfc-966c-e821eba34923, skipping ID generation
2026-03-24 16:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64ddf43-71d6-5dfc-966c-e821eba34923 with scrape type 1
2026-03-24 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c64ddf43-71d6-5dfc-966c-e821eba34923 sending to next pipeline
2026-03-24 16:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c64ddf43-71d6-5dfc-966c-e821eba34923, identifier: 1980667
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0350>
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/1.jpg saved to cache
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d72b10>
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/2.jpg saved to cache
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/3.jpg not downloaded yet
2026-03-24 16:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c64ddf43-71d6-5dfc-966c-e821eba34923 with identifier: 1980667
2026-03-24 16:46:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c64ddf43-71d6-5dfc-966c-e821eba34923 with identifier: 1980667
2026-03-24 16:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c64ddf43-71d6-5dfc-966c-e821eba34923 with identifier: 1980667 to the API
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PEINTURE OPAQUE BLANC BAN',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c64ddf43-71d6-5dfc-966c-e821eba34923',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 118632,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478606,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c64ddf43-71d6-5dfc-966c-e821eba34923/c64ddf43-71d6-5dfc-966c-e821eba34923_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/b8a5eb478d2b4c78a7755ff984acc2d8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-03',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 1.5 BlueHDi 120ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Expert Fg Standard 1.5 BlueHDi 120ch S&S Asphalt',
'vin': None,
'year': 2021}
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980667%27 HTTP/1.1" 200 None
2026-03-24 16:46:55 [ayvens.fr] INFO: Saving data for 1980667: {'created_time': 1774370815.822674, 'last_price_update_time': 1774370815.822685, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980667') HTTP/1.1" 204 0
2026-03-24 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/4.jpg not downloaded yet
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8207290>
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/3.jpg saved to cache
2026-03-24 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56a6d90>
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/4.jpg saved to cache
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0c550>
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/6.jpg saved to cache
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/5.jpg not downloaded yet
2026-03-24 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/6.jpg not downloaded yet
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b62e90>
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/5.jpg saved to cache
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/7.jpg not downloaded yet
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/8.jpg not downloaded yet
2026-03-24 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:56 [ayvens.fr] INFO: Found listing with ID: 1980670
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980670%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [ayvens.fr] INFO: Scrape type for 1980670: 1
2026-03-24 16:46:56 [ayvens.fr] INFO: Extracting data for car ID: 1980670
2026-03-24 16:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9703c4b5-a496-5246-82de-679054b71efe with identifier: 1980670
2026-03-24 16:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9703c4b5-a496-5246-82de-679054b71efe with scrape type 1
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/1.jpg not downloaded yet
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b3990>
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/7.jpg saved to cache
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454c510>
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F3e4a98ac31d24447b7550c936c4a980f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/8.jpg saved to cache
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0933b3f-9655-5553-8eda-72f794e42b62
2026-03-24 16:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0933b3f-9655-5553-8eda-72f794e42b62, skipping ID generation
2026-03-24 16:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0933b3f-9655-5553-8eda-72f794e42b62 with scrape type 1
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0933b3f-9655-5553-8eda-72f794e42b62 sending to next pipeline
2026-03-24 16:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e0933b3f-9655-5553-8eda-72f794e42b62, identifier: 1980668
2026-03-24 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/2.jpg not downloaded yet
2026-03-24 16:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e0933b3f-9655-5553-8eda-72f794e42b62 with identifier: 1980668
2026-03-24 16:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e0933b3f-9655-5553-8eda-72f794e42b62 with identifier: 1980668
2026-03-24 16:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e0933b3f-9655-5553-8eda-72f794e42b62 with identifier: 1980668 to the API
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'e0933b3f-9655-5553-8eda-72f794e42b62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 49504,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0933b3f-9655-5553-8eda-72f794e42b62/e0933b3f-9655-5553-8eda-72f794e42b62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/3e4a98ac31d24447b7550c936c4a980f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-04',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 1h Dynamic Business + Programme Beyond Zero '
'Academy',
'transmission': 'automatic',
'trim': 'Corolla 1h Dynamic Business + Programme Beyond Zero Academy',
'vin': None,
'year': 2023}
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980668%27 HTTP/1.1" 200 None
2026-03-24 16:46:56 [ayvens.fr] INFO: Saving data for 1980668: {'created_time': 1774370816.896204, 'last_price_update_time': 1774370816.896215, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980668') HTTP/1.1" 204 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/3.jpg not downloaded yet
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459ee10>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/1.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f7210>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/2.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d86f50>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/3.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/4.jpg not downloaded yet
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/5.jpg not downloaded yet
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/6.jpg not downloaded yet
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/7.jpg not downloaded yet
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/8.jpg not downloaded yet
2026-03-24 16:46:57 [ayvens.fr] INFO: Found listing with ID: 1980671
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980671%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [ayvens.fr] INFO: Scrape type for 1980671: 1
2026-03-24 16:46:57 [ayvens.fr] INFO: Extracting data for car ID: 1980671
2026-03-24 16:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 with identifier: 1980671
2026-03-24 16:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 with scrape type 1
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/1.jpg not downloaded yet
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/2.jpg not downloaded yet
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4fc50>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/7.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/3.jpg not downloaded yet
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/4.jpg not downloaded yet
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7f3d0>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/6.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79ffb50>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/5.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bafa50>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/4.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba3b10>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe8981f7e83c14087ad6146ee117cea7d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/8.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee09534d-7d87-58a9-9146-e4a62fc077ca
2026-03-24 16:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee09534d-7d87-58a9-9146-e4a62fc077ca, skipping ID generation
2026-03-24 16:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee09534d-7d87-58a9-9146-e4a62fc077ca with scrape type 1
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee09534d-7d87-58a9-9146-e4a62fc077ca sending to next pipeline
2026-03-24 16:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ee09534d-7d87-58a9-9146-e4a62fc077ca, identifier: 1980669
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7e04690>
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/1.jpg saved to cache
2026-03-24 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ee09534d-7d87-58a9-9146-e4a62fc077ca with identifier: 1980669
2026-03-24 16:46:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ee09534d-7d87-58a9-9146-e4a62fc077ca with identifier: 1980669
2026-03-24 16:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ee09534d-7d87-58a9-9146-e4a62fc077ca with identifier: 1980669 to the API
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR UNI',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'ee09534d-7d87-58a9-9146-e4a62fc077ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 87470,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271794,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee09534d-7d87-58a9-9146-e4a62fc077ca/ee09534d-7d87-58a9-9146-e4a62fc077ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e8981f7e83c14087ad6146ee117cea7d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Standard RWD Plus',
'transmission': 'automatic',
'trim': 'Model 3 Standard RWD Plus',
'vin': None,
'year': 2022}
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980669%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [ayvens.fr] INFO: Saving data for 1980669: {'created_time': 1774370818.344847, 'last_price_update_time': 1774370818.344863, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980669') HTTP/1.1" 204 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/5.jpg not downloaded yet
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb9650>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/2.jpg saved to cache
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ed410>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/3.jpg saved to cache
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/6.jpg not downloaded yet
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/7.jpg not downloaded yet
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fbc90>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/4.jpg saved to cache
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ec590>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/6.jpg saved to cache
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/8.jpg not downloaded yet
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103950>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/5.jpg saved to cache
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103950>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/7.jpg saved to cache
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:58 [ayvens.fr] INFO: Found listing with ID: 1980672
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980672%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [ayvens.fr] INFO: Scrape type for 1980672: 1
2026-03-24 16:46:58 [ayvens.fr] INFO: Extracting data for car ID: 1980672
2026-03-24 16:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b74f15af-b73a-5ff5-9812-f8eba6f34726 with identifier: 1980672
2026-03-24 16:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74f15af-b73a-5ff5-9812-f8eba6f34726 with scrape type 1
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/1.jpg not downloaded yet
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/2.jpg not downloaded yet
2026-03-24 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d50a50>
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/1.jpg saved to cache
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e47f50>
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F8d2e054658744bd4ae3a1c28c6e98f1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/8.jpg saved to cache
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9703c4b5-a496-5246-82de-679054b71efe
2026-03-24 16:46:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9703c4b5-a496-5246-82de-679054b71efe, skipping ID generation
2026-03-24 16:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9703c4b5-a496-5246-82de-679054b71efe with scrape type 1
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9703c4b5-a496-5246-82de-679054b71efe sending to next pipeline
2026-03-24 16:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9703c4b5-a496-5246-82de-679054b71efe, identifier: 1980670
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77390>
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/2.jpg saved to cache
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/3.jpg not downloaded yet
2026-03-24 16:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9703c4b5-a496-5246-82de-679054b71efe with identifier: 1980670
2026-03-24 16:46:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9703c4b5-a496-5246-82de-679054b71efe with identifier: 1980670
2026-03-24 16:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9703c4b5-a496-5246-82de-679054b71efe with identifier: 1980670 to the API
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 20,
'color': 'BLANC DIGITAL METALLIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '9703c4b5-a496-5246-82de-679054b71efe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE A',
'odometer': 23809,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9703c4b5-a496-5246-82de-679054b71efe/9703c4b5-a496-5246-82de-679054b71efe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/8d2e054658744bd4ae3a1c28c6e98f1e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE A Classe A 250 e 163+109ch Business Line '
'8G-DCT',
'transmission': 'automatic',
'trim': 'Classe A 250 e 163+109ch Business Line 8G-DCT',
'vin': None,
'year': 2023}
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980670%27 HTTP/1.1" 200 None
2026-03-24 16:46:59 [ayvens.fr] INFO: Saving data for 1980670: {'created_time': 1774370819.907686, 'last_price_update_time': 1774370819.907698, 'auction_closing_time': 1774605600.0}
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980670') HTTP/1.1" 204 0
2026-03-24 16:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/4.jpg not downloaded yet
2026-03-24 16:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c61090>
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/3.jpg saved to cache
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fd4d0>
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/4.jpg saved to cache
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6058710>
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/5.jpg saved to cache
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/5.jpg not downloaded yet
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/6.jpg not downloaded yet
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ed890>
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/6.jpg saved to cache
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570ca50>
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/8.jpg saved to cache
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/7.jpg not downloaded yet
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b74050>
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fdf7982533b8f45ebb22e83e4ad6b1ae0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/7.jpg saved to cache
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739
2026-03-24 16:47:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739, skipping ID generation
2026-03-24 16:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 with scrape type 1
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 sending to next pipeline
2026-03-24 16:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739, identifier: 1980671
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/8.jpg not downloaded yet
2026-03-24 16:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 with identifier: 1980671
2026-03-24 16:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 with identifier: 1980671
2026-03-24 16:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739 with identifier: 1980671 to the API
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 110594,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739/29e8d2e9-c8d6-54e6-a7a1-7ca6c440f739_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/df7982533b8f45ebb22e83e4ad6b1ae0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 265ch PHEV Creative BVA6 HTRAC',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 265ch PHEV Creative BVA6 HTRAC',
'vin': None,
'year': 2023}
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980671%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [ayvens.fr] INFO: Saving data for 1980671: {'created_time': 1774370821.058263, 'last_price_update_time': 1774370821.058274, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980671') HTTP/1.1" 204 0
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [ayvens.fr] INFO: Found listing with ID: 1980673
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980673%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [ayvens.fr] INFO: Scrape type for 1980673: 1
2026-03-24 16:47:01 [ayvens.fr] INFO: Extracting data for car ID: 1980673
2026-03-24 16:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b08e4d-e24b-5a4d-8e44-f4a167a1deec with identifier: 1980673
2026-03-24 16:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec with scrape type 1
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/1.jpg not downloaded yet
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/2.jpg not downloaded yet
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60505d0>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/2.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d71650>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/1.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d71290>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/4.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/3.jpg not downloaded yet
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/4.jpg not downloaded yet
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6059f90>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/3.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/5.jpg not downloaded yet
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/6.jpg not downloaded yet
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d30350>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/5.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e46a90>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/7.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5410>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/6.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/7.jpg not downloaded yet
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/8.jpg not downloaded yet
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e47010>
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe72fca5b6d6454aa5a56b04a2e87c72%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/8.jpg saved to cache
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b74f15af-b73a-5ff5-9812-f8eba6f34726
2026-03-24 16:47:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b74f15af-b73a-5ff5-9812-f8eba6f34726, skipping ID generation
2026-03-24 16:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74f15af-b73a-5ff5-9812-f8eba6f34726 with scrape type 1
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b74f15af-b73a-5ff5-9812-f8eba6f34726 sending to next pipeline
2026-03-24 16:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b74f15af-b73a-5ff5-9812-f8eba6f34726, identifier: 1980672
2026-03-24 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:01 [ayvens.fr] INFO: Found listing with ID: 1980674
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980674%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [ayvens.fr] INFO: Scrape type for 1980674: 1
2026-03-24 16:47:01 [ayvens.fr] INFO: Extracting data for car ID: 1980674
2026-03-24 16:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 268cdd07-b69a-5dc4-9984-090365e58496 with identifier: 1980674
2026-03-24 16:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268cdd07-b69a-5dc4-9984-090365e58496 with scrape type 1
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/1.jpg not downloaded yet
2026-03-24 16:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b74f15af-b73a-5ff5-9812-f8eba6f34726 with identifier: 1980672
2026-03-24 16:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b74f15af-b73a-5ff5-9812-f8eba6f34726 with identifier: 1980672
2026-03-24 16:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b74f15af-b73a-5ff5-9812-f8eba6f34726 with identifier: 1980672 to the API
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b74f15af-b73a-5ff5-9812-f8eba6f34726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 100859,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382862,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74f15af-b73a-5ff5-9812-f8eba6f34726/b74f15af-b73a-5ff5-9812-f8eba6f34726_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be72fca5b6d6454aa5a56b04a2e87c72/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 2.5 Hybride 222ch Lounge AWD-i',
'transmission': 'automatic',
'trim': 'RAV4 2.5 Hybride 222ch Lounge AWD-i',
'vin': None,
'year': 2022}
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980672%27 HTTP/1.1" 200 None
2026-03-24 16:47:02 [ayvens.fr] INFO: Saving data for 1980672: {'created_time': 1774370822.417971, 'last_price_update_time': 1774370822.417982, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980672') HTTP/1.1" 204 0
2026-03-24 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/2.jpg not downloaded yet
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f6c50>
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/1.jpg saved to cache
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/3.jpg not downloaded yet
2026-03-24 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/4.jpg not downloaded yet
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4556b90>
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/4.jpg saved to cache
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb92d0>
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/2.jpg saved to cache
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/5.jpg not downloaded yet
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/6.jpg not downloaded yet
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc1b10>
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/6.jpg saved to cache
2026-03-24 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce310>
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/3.jpg saved to cache
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf85d0>
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/5.jpg saved to cache
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611a890>
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/7.jpg saved to cache
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/7.jpg not downloaded yet
2026-03-24 16:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/8.jpg not downloaded yet
2026-03-24 16:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:03 [ayvens.fr] INFO: Found listing with ID: 1980675
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980675%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [ayvens.fr] INFO: Scrape type for 1980675: 1
2026-03-24 16:47:03 [ayvens.fr] INFO: Extracting data for car ID: 1980675
2026-03-24 16:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26487bdf-b23e-5388-bd2c-5b002cc8389e with identifier: 1980675
2026-03-24 16:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26487bdf-b23e-5388-bd2c-5b002cc8389e with scrape type 1
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/1.jpg not downloaded yet
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/2.jpg not downloaded yet
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/3.jpg not downloaded yet
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/4.jpg not downloaded yet
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/5.jpg not downloaded yet
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5a250>
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdbed5d789b0a49448ffc38b5889206f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/8.jpg saved to cache
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec
2026-03-24 16:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2b08e4d-e24b-5a4d-8e44-f4a167a1deec, skipping ID generation
2026-03-24 16:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec with scrape type 1
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2b08e4d-e24b-5a4d-8e44-f4a167a1deec sending to next pipeline
2026-03-24 16:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f2b08e4d-e24b-5a4d-8e44-f4a167a1deec, identifier: 1980673
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bffad0>
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/1.jpg saved to cache
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60e90>
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/2.jpg saved to cache
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/6.jpg not downloaded yet
2026-03-24 16:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f2b08e4d-e24b-5a4d-8e44-f4a167a1deec with identifier: 1980673
2026-03-24 16:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f2b08e4d-e24b-5a4d-8e44-f4a167a1deec with identifier: 1980673
2026-03-24 16:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f2b08e4d-e24b-5a4d-8e44-f4a167a1deec with identifier: 1980673 to the API
2026-03-24 16:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'f2b08e4d-e24b-5a4d-8e44-f4a167a1deec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 46645,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b08e4d-e24b-5a4d-8e44-f4a167a1deec/f2b08e4d-e24b-5a4d-8e44-f4a167a1deec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dbed5d789b0a49448ffc38b5889206f5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ZOE Zoe E-Tech Business charge normale R110 Achat Intégral',
'transmission': 'automatic',
'trim': 'Zoe E-Tech Business charge normale R110 Achat Intégral',
'vin': None,
'year': 2021}
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980673%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [ayvens.fr] INFO: Saving data for 1980673: {'created_time': 1774370824.563572, 'last_price_update_time': 1774370824.563583, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980673') HTTP/1.1" 204 0
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/7.jpg not downloaded yet
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6058910>
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/4.jpg saved to cache
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e510>
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/3.jpg saved to cache
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/8.jpg not downloaded yet
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [ayvens.fr] INFO: Found listing with ID: 1980676
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980676%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [ayvens.fr] INFO: Scrape type for 1980676: 1
2026-03-24 16:47:04 [ayvens.fr] INFO: Extracting data for car ID: 1980676
2026-03-24 16:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d897f5f0-0c85-5e69-a194-4a67d8e3662b with identifier: 1980676
2026-03-24 16:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d897f5f0-0c85-5e69-a194-4a67d8e3662b with scrape type 1
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/1.jpg not downloaded yet
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/2.jpg not downloaded yet
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/3.jpg not downloaded yet
2026-03-24 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/4.jpg not downloaded yet
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0db10>
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/6.jpg saved to cache
2026-03-24 16:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4d450>
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/5.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571a810>
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/1.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf43d0>
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/7.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/5.jpg not downloaded yet
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf2810>
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/2.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/6.jpg not downloaded yet
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb9190>
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F21a909bd6b774b4d85c8a832fc125708%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/8.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 268cdd07-b69a-5dc4-9984-090365e58496
2026-03-24 16:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 268cdd07-b69a-5dc4-9984-090365e58496, skipping ID generation
2026-03-24 16:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268cdd07-b69a-5dc4-9984-090365e58496 with scrape type 1
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 268cdd07-b69a-5dc4-9984-090365e58496 sending to next pipeline
2026-03-24 16:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 268cdd07-b69a-5dc4-9984-090365e58496, identifier: 1980674
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9f5d0>
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/3.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf21d0>
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/4.jpg saved to cache
2026-03-24 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 268cdd07-b69a-5dc4-9984-090365e58496 with identifier: 1980674
2026-03-24 16:47:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 268cdd07-b69a-5dc4-9984-090365e58496 with identifier: 1980674
2026-03-24 16:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 268cdd07-b69a-5dc4-9984-090365e58496 with identifier: 1980674 to the API
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'SPARKLING COPPER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '268cdd07-b69a-5dc4-9984-090365e58496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 ACTIVE TOURE',
'odometer': 49193,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346501,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268cdd07-b69a-5dc4-9984-090365e58496/268cdd07-b69a-5dc4-9984-090365e58496_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/21a909bd6b774b4d85c8a832fc125708/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-15',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 2 ACTIVE TOURE Série 2 ActiveTourer 218i 136ch Business '
'Design DKG7',
'transmission': 'automatic',
'trim': 'Série 2 ActiveTourer 218i 136ch Business Design DKG7',
'vin': None,
'year': 2024}
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980674%27 HTTP/1.1" 200 None
2026-03-24 16:47:06 [ayvens.fr] INFO: Saving data for 1980674: {'created_time': 1774370826.161318, 'last_price_update_time': 1774370826.16133, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980674') HTTP/1.1" 204 0
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/7.jpg not downloaded yet
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cbac90>
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/7.jpg saved to cache
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/8.jpg not downloaded yet
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:06 [ayvens.fr] INFO: Found listing with ID: 1980677
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980677%27 HTTP/1.1" 200 None
2026-03-24 16:47:06 [ayvens.fr] INFO: Scrape type for 1980677: 1
2026-03-24 16:47:06 [ayvens.fr] INFO: Extracting data for car ID: 1980677
2026-03-24 16:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d93b868-5ec7-553a-8052-3ac13679674d with identifier: 1980677
2026-03-24 16:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d93b868-5ec7-553a-8052-3ac13679674d with scrape type 1
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/1.jpg not downloaded yet
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d01c90>
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/6.jpg saved to cache
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7db3510>
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/8.jpg saved to cache
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c78d90>
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F724247788c0b4b7c999d9dca8adb6ce4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/5.jpg saved to cache
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26487bdf-b23e-5388-bd2c-5b002cc8389e
2026-03-24 16:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26487bdf-b23e-5388-bd2c-5b002cc8389e, skipping ID generation
2026-03-24 16:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26487bdf-b23e-5388-bd2c-5b002cc8389e with scrape type 1
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26487bdf-b23e-5388-bd2c-5b002cc8389e sending to next pipeline
2026-03-24 16:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 26487bdf-b23e-5388-bd2c-5b002cc8389e, identifier: 1980675
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/2.jpg not downloaded yet
2026-03-24 16:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 26487bdf-b23e-5388-bd2c-5b002cc8389e with identifier: 1980675
2026-03-24 16:47:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 26487bdf-b23e-5388-bd2c-5b002cc8389e with identifier: 1980675
2026-03-24 16:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 26487bdf-b23e-5388-bd2c-5b002cc8389e with identifier: 1980675 to the API
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS NUIT',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '26487bdf-b23e-5388-bd2c-5b002cc8389e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 31284,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298425,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26487bdf-b23e-5388-bd2c-5b002cc8389e/26487bdf-b23e-5388-bd2c-5b002cc8389e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/724247788c0b4b7c999d9dca8adb6ce4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Standard RWD',
'transmission': 'automatic',
'trim': 'Model Y Standard RWD',
'vin': None,
'year': 2023}
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980675%27 HTTP/1.1" 200 None
2026-03-24 16:47:07 [ayvens.fr] INFO: Saving data for 1980675: {'created_time': 1774370827.054751, 'last_price_update_time': 1774370827.054762, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980675') HTTP/1.1" 204 0
2026-03-24 16:47:07 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -2 pages/min), scraped 67 items (at 40 items/min)
2026-03-24 16:47:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/3.jpg not downloaded yet
2026-03-24 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce2490>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/1.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc7010>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/2.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570bf10>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/3.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e619a3d0>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/4.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/4.jpg not downloaded yet
2026-03-24 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/5.jpg not downloaded yet
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb790>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/5.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/6.jpg not downloaded yet
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/7.jpg not downloaded yet
2026-03-24 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f7bd0>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/7.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75890>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/6.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddd610>
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F05c44616828945a1a70e95cb7cb02ea2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/8.jpg saved to cache
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d897f5f0-0c85-5e69-a194-4a67d8e3662b
2026-03-24 16:47:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d897f5f0-0c85-5e69-a194-4a67d8e3662b, skipping ID generation
2026-03-24 16:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d897f5f0-0c85-5e69-a194-4a67d8e3662b with scrape type 1
2026-03-24 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d897f5f0-0c85-5e69-a194-4a67d8e3662b sending to next pipeline
2026-03-24 16:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d897f5f0-0c85-5e69-a194-4a67d8e3662b, identifier: 1980676
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/8.jpg not downloaded yet
2026-03-24 16:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d897f5f0-0c85-5e69-a194-4a67d8e3662b with identifier: 1980676
2026-03-24 16:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d897f5f0-0c85-5e69-a194-4a67d8e3662b with identifier: 1980676
2026-03-24 16:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d897f5f0-0c85-5e69-a194-4a67d8e3662b with identifier: 1980676 to the API
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd897f5f0-0c85-5e69-a194-4a67d8e3662b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 112889,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299828,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897f5f0-0c85-5e69-a194-4a67d8e3662b/d897f5f0-0c85-5e69-a194-4a67d8e3662b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/05c44616828945a1a70e95cb7cb02ea2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech 140ch Business -21',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech 140ch Business -21',
'vin': None,
'year': 2021}
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980676%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [ayvens.fr] INFO: Saving data for 1980676: {'created_time': 1774370828.37528, 'last_price_update_time': 1774370828.375292, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980676') HTTP/1.1" 204 0
2026-03-24 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:08 [ayvens.fr] INFO: Found listing with ID: 1980678
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980678%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [ayvens.fr] INFO: Scrape type for 1980678: 1
2026-03-24 16:47:08 [ayvens.fr] INFO: Extracting data for car ID: 1980678
2026-03-24 16:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0922b7d4-e79e-5439-b302-6caefebbb29a with identifier: 1980678
2026-03-24 16:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0922b7d4-e79e-5439-b302-6caefebbb29a with scrape type 1
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/1.jpg not downloaded yet
2026-03-24 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bafcd0>
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/1.jpg saved to cache
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/2.jpg not downloaded yet
2026-03-24 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/3.jpg not downloaded yet
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce3110>
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/3.jpg saved to cache
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/4.jpg not downloaded yet
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/5.jpg not downloaded yet
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e610>
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/2.jpg saved to cache
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bafa50>
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/4.jpg saved to cache
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6042f50>
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/5.jpg saved to cache
2026-03-24 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68ed0>
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/6.jpg saved to cache
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/6.jpg not downloaded yet
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/7.jpg not downloaded yet
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/8.jpg not downloaded yet
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [ayvens.fr] INFO: Found listing with ID: 1980679
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980679%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [ayvens.fr] INFO: Scrape type for 1980679: 1
2026-03-24 16:47:09 [ayvens.fr] INFO: Extracting data for car ID: 1980679
2026-03-24 16:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7752c515-f870-5f36-8f03-bd2305f5a6b9 with identifier: 1980679
2026-03-24 16:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7752c515-f870-5f36-8f03-bd2305f5a6b9 with scrape type 1
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/1.jpg not downloaded yet
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/2.jpg not downloaded yet
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/3.jpg not downloaded yet
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d02a50>
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/7.jpg saved to cache
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/4.jpg not downloaded yet
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/5.jpg not downloaded yet
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/6.jpg not downloaded yet
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbbdd0>
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F9ff621a95c7b4390927dc7857d64da5b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/8.jpg saved to cache
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d93b868-5ec7-553a-8052-3ac13679674d
2026-03-24 16:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d93b868-5ec7-553a-8052-3ac13679674d, skipping ID generation
2026-03-24 16:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d93b868-5ec7-553a-8052-3ac13679674d with scrape type 1
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d93b868-5ec7-553a-8052-3ac13679674d sending to next pipeline
2026-03-24 16:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6d93b868-5ec7-553a-8052-3ac13679674d, identifier: 1980677
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfdfd0>
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/1.jpg saved to cache
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3d850>
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/2.jpg saved to cache
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b8a50>
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/3.jpg saved to cache
2026-03-24 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6d93b868-5ec7-553a-8052-3ac13679674d with identifier: 1980677
2026-03-24 16:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6d93b868-5ec7-553a-8052-3ac13679674d with identifier: 1980677
2026-03-24 16:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6d93b868-5ec7-553a-8052-3ac13679674d with identifier: 1980677 to the API
2026-03-24 16:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '6d93b868-5ec7-553a-8052-3ac13679674d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 119434,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301862,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d93b868-5ec7-553a-8052-3ac13679674d/6d93b868-5ec7-553a-8052-3ac13679674d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411840,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/9ff621a95c7b4390927dc7857d64da5b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-22',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Business EAT6',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Business EAT6',
'vin': None,
'year': 2019}
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980677%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [ayvens.fr] INFO: Saving data for 1980677: {'created_time': 1774370830.592751, 'last_price_update_time': 1774370830.592762, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980677') HTTP/1.1" 204 0
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/7.jpg not downloaded yet
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c57890>
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/6.jpg saved to cache
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4dd0>
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/5.jpg saved to cache
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/8.jpg not downloaded yet
2026-03-24 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba1b10>
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/4.jpg saved to cache
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:10 [ayvens.fr] INFO: Found listing with ID: 1980680
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980680%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [ayvens.fr] INFO: Scrape type for 1980680: 1
2026-03-24 16:47:10 [ayvens.fr] INFO: Extracting data for car ID: 1980680
2026-03-24 16:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53740550-4029-5be0-aeb0-aad1d0fb80e5 with identifier: 1980680
2026-03-24 16:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53740550-4029-5be0-aeb0-aad1d0fb80e5 with scrape type 1
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/1.jpg not downloaded yet
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/2.jpg not downloaded yet
2026-03-24 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/3.jpg not downloaded yet
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceb650>
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/8.jpg saved to cache
2026-03-24 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a6cd0>
2026-03-24 16:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa60205b21dfa45d48a667676134df407%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/7.jpg saved to cache
2026-03-24 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0922b7d4-e79e-5439-b302-6caefebbb29a
2026-03-24 16:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0922b7d4-e79e-5439-b302-6caefebbb29a, skipping ID generation
2026-03-24 16:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0922b7d4-e79e-5439-b302-6caefebbb29a with scrape type 1
2026-03-24 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0922b7d4-e79e-5439-b302-6caefebbb29a sending to next pipeline
2026-03-24 16:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0922b7d4-e79e-5439-b302-6caefebbb29a, identifier: 1980678
2026-03-24 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0922b7d4-e79e-5439-b302-6caefebbb29a with identifier: 1980678
2026-03-24 16:47:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0922b7d4-e79e-5439-b302-6caefebbb29a with identifier: 1980678
2026-03-24 16:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0922b7d4-e79e-5439-b302-6caefebbb29a with identifier: 1980678 to the API
2026-03-24 16:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '0922b7d4-e79e-5439-b302-6caefebbb29a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 122339,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333782,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0922b7d4-e79e-5439-b302-6caefebbb29a/0922b7d4-e79e-5439-b302-6caefebbb29a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a60205b21dfa45d48a667676134df407/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 CRDi 136ch MHEV Black Edition Business '
'4x2 DCT7',
'transmission': 'automatic',
'trim': 'Sportage 1.6 CRDi 136ch MHEV Black Edition Business 4x2 DCT7',
'vin': None,
'year': 2021}
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980678%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [ayvens.fr] INFO: Saving data for 1980678: {'created_time': 1774370833.044493, 'last_price_update_time': 1774370833.044504, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980678') HTTP/1.1" 204 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/4.jpg not downloaded yet
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459fd50>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/1.jpg saved to cache
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f40d0>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/4.jpg saved to cache
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/5.jpg not downloaded yet
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c566d0>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/2.jpg saved to cache
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1be10>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/3.jpg saved to cache
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4599c10>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/5.jpg saved to cache
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/6.jpg not downloaded yet
2026-03-24 16:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/7.jpg not downloaded yet
2026-03-24 16:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/8.jpg not downloaded yet
2026-03-24 16:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:13 [ayvens.fr] INFO: Found listing with ID: 1980681
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980681%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [ayvens.fr] INFO: Scrape type for 1980681: 1
2026-03-24 16:47:13 [ayvens.fr] INFO: Extracting data for car ID: 1980681
2026-03-24 16:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2add1489-0564-59b1-8632-4e91e692f8eb with identifier: 1980681
2026-03-24 16:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2add1489-0564-59b1-8632-4e91e692f8eb with scrape type 1
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/1.jpg not downloaded yet
2026-03-24 16:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/2.jpg not downloaded yet
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/3.jpg not downloaded yet
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75190>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/7.jpg saved to cache
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/4.jpg not downloaded yet
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605be50>
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/8.jpg saved to cache
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6144150>
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F20cd0cdea5b34d8990bd4620f4e5ed66%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/6.jpg saved to cache
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7752c515-f870-5f36-8f03-bd2305f5a6b9
2026-03-24 16:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7752c515-f870-5f36-8f03-bd2305f5a6b9, skipping ID generation
2026-03-24 16:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7752c515-f870-5f36-8f03-bd2305f5a6b9 with scrape type 1
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7752c515-f870-5f36-8f03-bd2305f5a6b9 sending to next pipeline
2026-03-24 16:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7752c515-f870-5f36-8f03-bd2305f5a6b9, identifier: 1980679
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/5.jpg not downloaded yet
2026-03-24 16:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7752c515-f870-5f36-8f03-bd2305f5a6b9 with identifier: 1980679
2026-03-24 16:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7752c515-f870-5f36-8f03-bd2305f5a6b9 with identifier: 1980679
2026-03-24 16:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7752c515-f870-5f36-8f03-bd2305f5a6b9 with identifier: 1980679 to the API
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '7752c515-f870-5f36-8f03-bd2305f5a6b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 90974,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7752c515-f870-5f36-8f03-bd2305f5a6b9/7752c515-f870-5f36-8f03-bd2305f5a6b9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/20cd0cdea5b34d8990bd4620f4e5ed66/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.2 PureTech 82ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.2 PureTech 82ch S&S Feel Nav',
'vin': None,
'year': 2019}
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980679%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [ayvens.fr] INFO: Saving data for 1980679: {'created_time': 1774370834.563092, 'last_price_update_time': 1774370834.563104, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980679') HTTP/1.1" 204 0
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a96d0>
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/1.jpg saved to cache
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83c10>
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/2.jpg saved to cache
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9fa10>
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/3.jpg saved to cache
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/6.jpg not downloaded yet
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/7.jpg not downloaded yet
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/8.jpg not downloaded yet
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [ayvens.fr] INFO: Found listing with ID: 1980682
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980682%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [ayvens.fr] INFO: Scrape type for 1980682: 1
2026-03-24 16:47:14 [ayvens.fr] INFO: Extracting data for car ID: 1980682
2026-03-24 16:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf11d08-347a-57ba-8ce9-c1abaccac797 with identifier: 1980682
2026-03-24 16:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf11d08-347a-57ba-8ce9-c1abaccac797 with scrape type 1
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/1.jpg not downloaded yet
2026-03-24 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/2.jpg not downloaded yet
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/3.jpg not downloaded yet
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/4.jpg not downloaded yet
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb7d0>
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/7.jpg saved to cache
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/5.jpg not downloaded yet
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d004d0>
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/4.jpg saved to cache
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9dcd0>
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/8.jpg saved to cache
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dc0c90>
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/5.jpg saved to cache
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce3cd0>
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fdb392d3b9eac44f2988816c0ea9efb51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/6.jpg saved to cache
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53740550-4029-5be0-aeb0-aad1d0fb80e5
2026-03-24 16:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53740550-4029-5be0-aeb0-aad1d0fb80e5, skipping ID generation
2026-03-24 16:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53740550-4029-5be0-aeb0-aad1d0fb80e5 with scrape type 1
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53740550-4029-5be0-aeb0-aad1d0fb80e5 sending to next pipeline
2026-03-24 16:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 53740550-4029-5be0-aeb0-aad1d0fb80e5, identifier: 1980680
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/6.jpg not downloaded yet
2026-03-24 16:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 53740550-4029-5be0-aeb0-aad1d0fb80e5 with identifier: 1980680
2026-03-24 16:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 53740550-4029-5be0-aeb0-aad1d0fb80e5 with identifier: 1980680
2026-03-24 16:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 53740550-4029-5be0-aeb0-aad1d0fb80e5 with identifier: 1980680 to the API
2026-03-24 16:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '53740550-4029-5be0-aeb0-aad1d0fb80e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 131216,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53740550-4029-5be0-aeb0-aad1d0fb80e5/53740550-4029-5be0-aeb0-aad1d0fb80e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340044,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/db392d3b9eac44f2988816c0ea9efb51/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-03',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980680%27 HTTP/1.1" 200 None
2026-03-24 16:47:16 [ayvens.fr] INFO: Saving data for 1980680: {'created_time': 1774370836.47798, 'last_price_update_time': 1774370836.477991, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980680') HTTP/1.1" 204 0
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/7.jpg not downloaded yet
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2250>
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/1.jpg saved to cache
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1b4d0>
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/3.jpg saved to cache
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a5210>
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/2.jpg saved to cache
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/8.jpg not downloaded yet
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf32d0>
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/7.jpg saved to cache
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7e910>
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/4.jpg saved to cache
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4575ed0>
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/5.jpg saved to cache
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:16 [ayvens.fr] INFO: Found listing with ID: 1980683
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980683%27 HTTP/1.1" 200 None
2026-03-24 16:47:16 [ayvens.fr] INFO: Scrape type for 1980683: 1
2026-03-24 16:47:16 [ayvens.fr] INFO: Extracting data for car ID: 1980683
2026-03-24 16:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4788d61e-2617-5331-85f3-d0ed9a5989dd with identifier: 1980683
2026-03-24 16:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4788d61e-2617-5331-85f3-d0ed9a5989dd with scrape type 1
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/1.jpg not downloaded yet
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/2.jpg not downloaded yet
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7c7d0>
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/6.jpg saved to cache
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5717290>
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/1.jpg saved to cache
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6146150>
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/2.jpg saved to cache
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4e350>
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff9ac7e1d3d1f43499084d7a8053b07f7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/8.jpg saved to cache
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2add1489-0564-59b1-8632-4e91e692f8eb
2026-03-24 16:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2add1489-0564-59b1-8632-4e91e692f8eb, skipping ID generation
2026-03-24 16:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2add1489-0564-59b1-8632-4e91e692f8eb with scrape type 1
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2add1489-0564-59b1-8632-4e91e692f8eb sending to next pipeline
2026-03-24 16:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2add1489-0564-59b1-8632-4e91e692f8eb, identifier: 1980681
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a7f10>
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/3.jpg saved to cache
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2add1489-0564-59b1-8632-4e91e692f8eb with identifier: 1980681
2026-03-24 16:47:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2add1489-0564-59b1-8632-4e91e692f8eb with identifier: 1980681
2026-03-24 16:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2add1489-0564-59b1-8632-4e91e692f8eb with identifier: 1980681 to the API
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'EMERAUDE BLUE NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '2add1489-0564-59b1-8632-4e91e692f8eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 CACTUS',
'odometer': 119952,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256236,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add1489-0564-59b1-8632-4e91e692f8eb/2add1489-0564-59b1-8632-4e91e692f8eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f9ac7e1d3d1f43499084d7a8053b07f7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 CACTUS C4 PureTech 130ch S&S Shine EAT8',
'transmission': 'automatic',
'trim': 'C4 PureTech 130ch S&S Shine EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980681%27 HTTP/1.1" 200 None
2026-03-24 16:47:17 [ayvens.fr] INFO: Saving data for 1980681: {'created_time': 1774370837.910782, 'last_price_update_time': 1774370837.910795, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980681') HTTP/1.1" 204 0
2026-03-24 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/3.jpg not downloaded yet
2026-03-24 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/4.jpg not downloaded yet
2026-03-24 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/5.jpg not downloaded yet
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/6.jpg not downloaded yet
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/7.jpg not downloaded yet
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/8.jpg not downloaded yet
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a5150>
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/4.jpg saved to cache
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:18 [ayvens.fr] INFO: Found listing with ID: 1980684
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980684%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [ayvens.fr] INFO: Scrape type for 1980684: 1
2026-03-24 16:47:18 [ayvens.fr] INFO: Extracting data for car ID: 1980684
2026-03-24 16:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8bd0301-4959-5fa7-9f5a-f225cde76b21 with identifier: 1980684
2026-03-24 16:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8bd0301-4959-5fa7-9f5a-f225cde76b21 with scrape type 1
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/1.jpg not downloaded yet
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84c50>
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/5.jpg saved to cache
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75510>
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/6.jpg saved to cache
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/2.jpg not downloaded yet
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c683d0>
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/7.jpg saved to cache
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d71350>
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa583afa89592437e9760679de9f739aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/8.jpg saved to cache
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbf11d08-347a-57ba-8ce9-c1abaccac797
2026-03-24 16:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbf11d08-347a-57ba-8ce9-c1abaccac797, skipping ID generation
2026-03-24 16:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf11d08-347a-57ba-8ce9-c1abaccac797 with scrape type 1
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbf11d08-347a-57ba-8ce9-c1abaccac797 sending to next pipeline
2026-03-24 16:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bbf11d08-347a-57ba-8ce9-c1abaccac797, identifier: 1980682
2026-03-24 16:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/3.jpg not downloaded yet
2026-03-24 16:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bbf11d08-347a-57ba-8ce9-c1abaccac797 with identifier: 1980682
2026-03-24 16:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bbf11d08-347a-57ba-8ce9-c1abaccac797 with identifier: 1980682
2026-03-24 16:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bbf11d08-347a-57ba-8ce9-c1abaccac797 with identifier: 1980682 to the API
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'bbf11d08-347a-57ba-8ce9-c1abaccac797',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 13085,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf11d08-347a-57ba-8ce9-c1abaccac797/bbf11d08-347a-57ba-8ce9-c1abaccac797_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a583afa89592437e9760679de9f739aa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2024}
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980682%27 HTTP/1.1" 200 None
2026-03-24 16:47:19 [ayvens.fr] INFO: Saving data for 1980682: {'created_time': 1774370839.02472, 'last_price_update_time': 1774370839.024737, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980682') HTTP/1.1" 204 0
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/4.jpg not downloaded yet
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c55d90>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/1.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e1650>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/2.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/5.jpg not downloaded yet
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/6.jpg not downloaded yet
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0ed10>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/4.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7ff90>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/6.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5510>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/7.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7d2d0>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/3.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb88d0>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/5.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/7.jpg not downloaded yet
2026-03-24 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/8.jpg not downloaded yet
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf3a50>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F118d036533514801aeb958f5fcbc9ffe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/8.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4788d61e-2617-5331-85f3-d0ed9a5989dd
2026-03-24 16:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4788d61e-2617-5331-85f3-d0ed9a5989dd, skipping ID generation
2026-03-24 16:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4788d61e-2617-5331-85f3-d0ed9a5989dd with scrape type 1
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4788d61e-2617-5331-85f3-d0ed9a5989dd sending to next pipeline
2026-03-24 16:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4788d61e-2617-5331-85f3-d0ed9a5989dd, identifier: 1980683
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708f50>
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/1.jpg saved to cache
2026-03-24 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4788d61e-2617-5331-85f3-d0ed9a5989dd with identifier: 1980683
2026-03-24 16:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4788d61e-2617-5331-85f3-d0ed9a5989dd with identifier: 1980683
2026-03-24 16:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4788d61e-2617-5331-85f3-d0ed9a5989dd with identifier: 1980683 to the API
2026-03-24 16:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4788d61e-2617-5331-85f3-d0ed9a5989dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 109881,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404345,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404345,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4788d61e-2617-5331-85f3-d0ed9a5989dd/4788d61e-2617-5331-85f3-d0ed9a5989dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/118d036533514801aeb958f5fcbc9ffe/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980683%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [ayvens.fr] INFO: Saving data for 1980683: {'created_time': 1774370840.33357, 'last_price_update_time': 1774370840.333581, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980683') HTTP/1.1" 204 0
2026-03-24 16:47:20 [ayvens.fr] INFO: Found listing with ID: 1980685
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980685%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [ayvens.fr] INFO: Scrape type for 1980685: 1
2026-03-24 16:47:20 [ayvens.fr] INFO: Extracting data for car ID: 1980685
2026-03-24 16:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd880b55-b0a7-50aa-adc4-5463cf75cd39 with identifier: 1980685
2026-03-24 16:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd880b55-b0a7-50aa-adc4-5463cf75cd39 with scrape type 1
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/1.jpg not downloaded yet
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fed10>
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/2.jpg saved to cache
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/2.jpg not downloaded yet
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/3.jpg not downloaded yet
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6059f90>
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/4.jpg saved to cache
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/4.jpg not downloaded yet
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/5.jpg not downloaded yet
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fe650>
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/3.jpg saved to cache
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/6.jpg not downloaded yet
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56d4a50>
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/6.jpg saved to cache
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/7.jpg not downloaded yet
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60250>
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/5.jpg saved to cache
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd1250>
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/7.jpg saved to cache
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/8.jpg not downloaded yet
2026-03-24 16:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:20 [ayvens.fr] INFO: Found listing with ID: 1980686
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980686%27 HTTP/1.1" 200 None
2026-03-24 16:47:20 [ayvens.fr] INFO: Scrape type for 1980686: 1
2026-03-24 16:47:20 [ayvens.fr] INFO: Extracting data for car ID: 1980686
2026-03-24 16:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4896a8da-bf66-5cd5-b438-f0fd928e94d2 with identifier: 1980686
2026-03-24 16:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2 with scrape type 1
2026-03-24 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/1.jpg not downloaded yet
2026-03-24 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e452d0>
2026-03-24 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5042a063a89d426c8924863a52047be3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/8.jpg saved to cache
2026-03-24 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8bd0301-4959-5fa7-9f5a-f225cde76b21
2026-03-24 16:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8bd0301-4959-5fa7-9f5a-f225cde76b21, skipping ID generation
2026-03-24 16:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8bd0301-4959-5fa7-9f5a-f225cde76b21 with scrape type 1
2026-03-24 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8bd0301-4959-5fa7-9f5a-f225cde76b21 sending to next pipeline
2026-03-24 16:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f8bd0301-4959-5fa7-9f5a-f225cde76b21, identifier: 1980684
2026-03-24 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/2.jpg not downloaded yet
2026-03-24 16:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f8bd0301-4959-5fa7-9f5a-f225cde76b21 with identifier: 1980684
2026-03-24 16:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f8bd0301-4959-5fa7-9f5a-f225cde76b21 with identifier: 1980684
2026-03-24 16:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f8bd0301-4959-5fa7-9f5a-f225cde76b21 with identifier: 1980684 to the API
2026-03-24 16:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f8bd0301-4959-5fa7-9f5a-f225cde76b21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 97432,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8bd0301-4959-5fa7-9f5a-f225cde76b21/f8bd0301-4959-5fa7-9f5a-f225cde76b21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5042a063a89d426c8924863a52047be3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2023}
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980684%27 HTTP/1.1" 200 None
2026-03-24 16:47:22 [ayvens.fr] INFO: Saving data for 1980684: {'created_time': 1774370842.326236, 'last_price_update_time': 1774370842.32625, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980684') HTTP/1.1" 204 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/3.jpg not downloaded yet
2026-03-24 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6051110>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/1.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccfe90>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/2.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77a50>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/4.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c70650>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/3.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/4.jpg not downloaded yet
2026-03-24 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/5.jpg not downloaded yet
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6145f90>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/5.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/6.jpg not downloaded yet
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/7.jpg not downloaded yet
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceb9d0>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/6.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d30d0>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/7.jpg saved to cache
2026-03-24 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4f950>
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd2509c8aed944ea3ba5bba87b1b95149%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/8.jpg saved to cache
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd880b55-b0a7-50aa-adc4-5463cf75cd39
2026-03-24 16:47:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd880b55-b0a7-50aa-adc4-5463cf75cd39, skipping ID generation
2026-03-24 16:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd880b55-b0a7-50aa-adc4-5463cf75cd39 with scrape type 1
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd880b55-b0a7-50aa-adc4-5463cf75cd39 sending to next pipeline
2026-03-24 16:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bd880b55-b0a7-50aa-adc4-5463cf75cd39, identifier: 1980685
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/8.jpg not downloaded yet
2026-03-24 16:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bd880b55-b0a7-50aa-adc4-5463cf75cd39 with identifier: 1980685
2026-03-24 16:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bd880b55-b0a7-50aa-adc4-5463cf75cd39 with identifier: 1980685
2026-03-24 16:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bd880b55-b0a7-50aa-adc4-5463cf75cd39 with identifier: 1980685 to the API
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'bd880b55-b0a7-50aa-adc4-5463cf75cd39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 120958,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd880b55-b0a7-50aa-adc4-5463cf75cd39/bd880b55-b0a7-50aa-adc4-5463cf75cd39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d2509c8aed944ea3ba5bba87b1b95149/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2021}
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980685%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [ayvens.fr] INFO: Saving data for 1980685: {'created_time': 1774370843.521545, 'last_price_update_time': 1774370843.521555, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980685') HTTP/1.1" 204 0
2026-03-24 16:47:23 [ayvens.fr] INFO: Found listing with ID: 1980687
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980687%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [ayvens.fr] INFO: Scrape type for 1980687: 1
2026-03-24 16:47:23 [ayvens.fr] INFO: Extracting data for car ID: 1980687
2026-03-24 16:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 578594a0-cb5f-51af-b4a9-e05ab3283ddd with identifier: 1980687
2026-03-24 16:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd with scrape type 1
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/1.jpg not downloaded yet
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4c310>
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/1.jpg saved to cache
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/2.jpg not downloaded yet
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/3.jpg not downloaded yet
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/4.jpg not downloaded yet
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/5.jpg not downloaded yet
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/6.jpg not downloaded yet
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/7.jpg not downloaded yet
2026-03-24 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/8.jpg not downloaded yet
2026-03-24 16:47:23 [ayvens.fr] INFO: Found listing with ID: 1980688
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980688%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [ayvens.fr] INFO: Scrape type for 1980688: 1
2026-03-24 16:47:23 [ayvens.fr] INFO: Extracting data for car ID: 1980688
2026-03-24 16:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c44339a-20dc-5fcd-bbd7-8189052951de with identifier: 1980688
2026-03-24 16:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c44339a-20dc-5fcd-bbd7-8189052951de with scrape type 1
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/1.jpg not downloaded yet
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7c950>
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/2.jpg saved to cache
2026-03-24 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cccb10>
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/4.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456e9d0>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/6.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/2.jpg not downloaded yet
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60eeb50>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/5.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/3.jpg not downloaded yet
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/4.jpg not downloaded yet
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57091d0>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/3.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccd0d0>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/7.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/5.jpg not downloaded yet
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69510>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/2.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60518d0>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F28beb7d9693349cb90c844de42efc73e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/8.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2
2026-03-24 16:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4896a8da-bf66-5cd5-b438-f0fd928e94d2, skipping ID generation
2026-03-24 16:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2 with scrape type 1
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4896a8da-bf66-5cd5-b438-f0fd928e94d2 sending to next pipeline
2026-03-24 16:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4896a8da-bf66-5cd5-b438-f0fd928e94d2, identifier: 1980686
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d302d0>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/1.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3350>
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/6.jpg saved to cache
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/6.jpg not downloaded yet
2026-03-24 16:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4896a8da-bf66-5cd5-b438-f0fd928e94d2 with identifier: 1980686
2026-03-24 16:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4896a8da-bf66-5cd5-b438-f0fd928e94d2 with identifier: 1980686
2026-03-24 16:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4896a8da-bf66-5cd5-b438-f0fd928e94d2 with identifier: 1980686 to the API
2026-03-24 16:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4896a8da-bf66-5cd5-b438-f0fd928e94d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 136180,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308782,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4896a8da-bf66-5cd5-b438-f0fd928e94d2/4896a8da-bf66-5cd5-b438-f0fd928e94d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/28beb7d9693349cb90c844de42efc73e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980686%27 HTTP/1.1" 200 None
2026-03-24 16:47:25 [ayvens.fr] INFO: Saving data for 1980686: {'created_time': 1774370845.620867, 'last_price_update_time': 1774370845.62088, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980686') HTTP/1.1" 204 0
2026-03-24 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/7.jpg not downloaded yet
2026-03-24 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7db39d0>
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/7.jpg saved to cache
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d24d0>
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/4.jpg saved to cache
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666ecd0>
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/3.jpg saved to cache
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605a650>
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/5.jpg saved to cache
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/8.jpg not downloaded yet
2026-03-24 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:25 [ayvens.fr] INFO: Found listing with ID: 1980689
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980689%27 HTTP/1.1" 200 None
2026-03-24 16:47:25 [ayvens.fr] INFO: Scrape type for 1980689: 1
2026-03-24 16:47:25 [ayvens.fr] INFO: Extracting data for car ID: 1980689
2026-03-24 16:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f969404-4c8d-5c0b-8f8e-147c5193b2ca with identifier: 1980689
2026-03-24 16:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca with scrape type 1
2026-03-24 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/1.jpg not downloaded yet
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573ba10>
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F3775cf95c0114bf38df318b3d8adcbc1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/8.jpg saved to cache
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd
2026-03-24 16:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 578594a0-cb5f-51af-b4a9-e05ab3283ddd, skipping ID generation
2026-03-24 16:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd with scrape type 1
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 578594a0-cb5f-51af-b4a9-e05ab3283ddd sending to next pipeline
2026-03-24 16:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 578594a0-cb5f-51af-b4a9-e05ab3283ddd, identifier: 1980687
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718450>
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/1.jpg saved to cache
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/2.jpg not downloaded yet
2026-03-24 16:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 578594a0-cb5f-51af-b4a9-e05ab3283ddd with identifier: 1980687
2026-03-24 16:47:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 578594a0-cb5f-51af-b4a9-e05ab3283ddd with identifier: 1980687
2026-03-24 16:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 578594a0-cb5f-51af-b4a9-e05ab3283ddd with identifier: 1980687 to the API
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'GRIS SQUALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '578594a0-cb5f-51af-b4a9-e05ab3283ddd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 40978,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_578594a0-cb5f-51af-b4a9-e05ab3283ddd/578594a0-cb5f-51af-b4a9-e05ab3283ddd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/3775cf95c0114bf38df318b3d8adcbc1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN JUKE Juke 1.0 DIG-T 114ch Business Edition DCT',
'transmission': 'automatic',
'trim': 'Juke 1.0 DIG-T 114ch Business Edition DCT',
'vin': None,
'year': 2022}
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980687%27 HTTP/1.1" 200 None
2026-03-24 16:47:26 [ayvens.fr] INFO: Saving data for 1980687: {'created_time': 1774370846.92879, 'last_price_update_time': 1774370846.928805, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980687') HTTP/1.1" 204 0
2026-03-24 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/3.jpg not downloaded yet
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5f410>
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/3.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571bc50>
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/2.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/4.jpg not downloaded yet
2026-03-24 16:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/5.jpg not downloaded yet
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c73590>
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/5.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7ced790>
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/4.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/6.jpg not downloaded yet
2026-03-24 16:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/7.jpg not downloaded yet
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d0b10>
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/7.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3f5d0>
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/6.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/8.jpg not downloaded yet
2026-03-24 16:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61150>
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F16b3a8a03f984be0815b4e18e100aa1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/8.jpg saved to cache
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c44339a-20dc-5fcd-bbd7-8189052951de
2026-03-24 16:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c44339a-20dc-5fcd-bbd7-8189052951de, skipping ID generation
2026-03-24 16:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c44339a-20dc-5fcd-bbd7-8189052951de with scrape type 1
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c44339a-20dc-5fcd-bbd7-8189052951de sending to next pipeline
2026-03-24 16:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2c44339a-20dc-5fcd-bbd7-8189052951de, identifier: 1980688
2026-03-24 16:47:27 [ayvens.fr] INFO: Found listing with ID: 1980690
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980690%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [ayvens.fr] INFO: Scrape type for 1980690: 1
2026-03-24 16:47:27 [ayvens.fr] INFO: Extracting data for car ID: 1980690
2026-03-24 16:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b172e71-a967-55dd-800d-7402c039b070 with identifier: 1980690
2026-03-24 16:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b172e71-a967-55dd-800d-7402c039b070 with scrape type 1
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/1.jpg not downloaded yet
2026-03-24 16:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2c44339a-20dc-5fcd-bbd7-8189052951de with identifier: 1980688
2026-03-24 16:47:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2c44339a-20dc-5fcd-bbd7-8189052951de with identifier: 1980688
2026-03-24 16:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2c44339a-20dc-5fcd-bbd7-8189052951de with identifier: 1980688 to the API
2026-03-24 16:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC PUR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '2c44339a-20dc-5fcd-bbd7-8189052951de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 33511,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c44339a-20dc-5fcd-bbd7-8189052951de/2c44339a-20dc-5fcd-bbd7-8189052951de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/16b3a8a03f984be0815b4e18e100aa1a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 116h Dynamic 5p',
'transmission': 'automatic',
'trim': 'Yaris 116h Dynamic 5p',
'vin': None,
'year': 2022}
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980688%27 HTTP/1.1" 200 None
2026-03-24 16:47:28 [ayvens.fr] INFO: Saving data for 1980688: {'created_time': 1774370848.62289, 'last_price_update_time': 1774370848.622907, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980688') HTTP/1.1" 204 0
2026-03-24 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/2.jpg not downloaded yet
2026-03-24 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d150>
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/1.jpg saved to cache
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/3.jpg not downloaded yet
2026-03-24 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/4.jpg not downloaded yet
2026-03-24 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e619b7d0>
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/3.jpg saved to cache
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/5.jpg not downloaded yet
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6041190>
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/2.jpg saved to cache
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/6.jpg not downloaded yet
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c734d0>
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/5.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d70990>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/4.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a66d0>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/6.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/7.jpg not downloaded yet
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/8.jpg not downloaded yet
2026-03-24 16:47:29 [ayvens.fr] INFO: Found listing with ID: 1980691
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980691%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [ayvens.fr] INFO: Scrape type for 1980691: 1
2026-03-24 16:47:29 [ayvens.fr] INFO: Extracting data for car ID: 1980691
2026-03-24 16:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 714e793d-f078-5897-9aea-f0c00593a977 with identifier: 1980691
2026-03-24 16:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714e793d-f078-5897-9aea-f0c00593a977 with scrape type 1
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/1.jpg not downloaded yet
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/2.jpg not downloaded yet
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/3.jpg not downloaded yet
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/4.jpg not downloaded yet
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/5.jpg not downloaded yet
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9cf50>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/2.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31c10>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/1.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e18b10>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/7.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56ff990>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/3.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/6.jpg not downloaded yet
2026-03-24 16:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/7.jpg not downloaded yet
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6119fd0>
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F327a7a4023154ff6978bc608be82dd26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/8.jpg saved to cache
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca
2026-03-24 16:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f969404-4c8d-5c0b-8f8e-147c5193b2ca, skipping ID generation
2026-03-24 16:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca with scrape type 1
2026-03-24 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f969404-4c8d-5c0b-8f8e-147c5193b2ca sending to next pipeline
2026-03-24 16:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1f969404-4c8d-5c0b-8f8e-147c5193b2ca, identifier: 1980689
2026-03-24 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79e3b50>
2026-03-24 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/4.jpg saved to cache
2026-03-24 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1f969404-4c8d-5c0b-8f8e-147c5193b2ca with identifier: 1980689
2026-03-24 16:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1f969404-4c8d-5c0b-8f8e-147c5193b2ca with identifier: 1980689
2026-03-24 16:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1f969404-4c8d-5c0b-8f8e-147c5193b2ca with identifier: 1980689 to the API
2026-03-24 16:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 242,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '1f969404-4c8d-5c0b-8f8e-147c5193b2ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'BOXER',
'odometer': 92803,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f969404-4c8d-5c0b-8f8e-147c5193b2ca/1f969404-4c8d-5c0b-8f8e-147c5193b2ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/327a7a4023154ff6978bc608be82dd26/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-12',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT BOXER Boxer Fg 435 L4H2 2.2 BlueHDi S&S 140ch Asphalt',
'transmission': 'manual',
'trim': 'Boxer Fg 435 L4H2 2.2 BlueHDi S&S 140ch Asphalt',
'vin': None,
'year': 2022}
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980689%27 HTTP/1.1" 200 None
2026-03-24 16:47:31 [ayvens.fr] INFO: Saving data for 1980689: {'created_time': 1774370851.395382, 'last_price_update_time': 1774370851.395401, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980689') HTTP/1.1" 204 0
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/8.jpg not downloaded yet
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [ayvens.fr] INFO: Found listing with ID: 1980692
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980692%27 HTTP/1.1" 200 None
2026-03-24 16:47:31 [ayvens.fr] INFO: Scrape type for 1980692: 1
2026-03-24 16:47:31 [ayvens.fr] INFO: Extracting data for car ID: 1980692
2026-03-24 16:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8b00ec4-6426-578c-a85c-f73ed250f370 with identifier: 1980692
2026-03-24 16:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8b00ec4-6426-578c-a85c-f73ed250f370 with scrape type 1
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/1.jpg not downloaded yet
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7b6a090>
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/7.jpg saved to cache
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/2.jpg not downloaded yet
2026-03-24 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/3.jpg not downloaded yet
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725590>
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/5.jpg saved to cache
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d00c90>
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/8.jpg saved to cache
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b0290>
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/2.jpg saved to cache
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b2450>
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/3.jpg saved to cache
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b69b10>
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6604d37673fe4d61853091998b7f48d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/6.jpg saved to cache
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b172e71-a967-55dd-800d-7402c039b070
2026-03-24 16:47:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b172e71-a967-55dd-800d-7402c039b070, skipping ID generation
2026-03-24 16:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b172e71-a967-55dd-800d-7402c039b070 with scrape type 1
2026-03-24 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b172e71-a967-55dd-800d-7402c039b070 sending to next pipeline
2026-03-24 16:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7b172e71-a967-55dd-800d-7402c039b070, identifier: 1980690
2026-03-24 16:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b87990>
2026-03-24 16:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/1.jpg saved to cache
2026-03-24 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/4.jpg not downloaded yet
2026-03-24 16:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7b172e71-a967-55dd-800d-7402c039b070 with identifier: 1980690
2026-03-24 16:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7b172e71-a967-55dd-800d-7402c039b070 with identifier: 1980690
2026-03-24 16:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7b172e71-a967-55dd-800d-7402c039b070 with identifier: 1980690 to the API
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '7b172e71-a967-55dd-800d-7402c039b070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 140954,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b172e71-a967-55dd-800d-7402c039b070/7b172e71-a967-55dd-800d-7402c039b070_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6604d37673fe4d61853091998b7f48d8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-23',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.2 PureTech 83ch Feel Business R',
'transmission': 'manual',
'trim': 'C3 Sté 1.2 PureTech 83ch Feel Business R',
'vin': None,
'year': 2022}
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980690%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [ayvens.fr] INFO: Saving data for 1980690: {'created_time': 1774370853.031355, 'last_price_update_time': 1774370853.031366, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980690') HTTP/1.1" 204 0
2026-03-24 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/5.jpg not downloaded yet
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7cc90>
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/4.jpg saved to cache
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459a110>
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/5.jpg saved to cache
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/6.jpg not downloaded yet
2026-03-24 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4574c90>
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/7.jpg saved to cache
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/7.jpg not downloaded yet
2026-03-24 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/8.jpg not downloaded yet
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6100b50>
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/6.jpg saved to cache
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7d9d0>
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd72e9cf34730488785b7f9efe35c52fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/8.jpg saved to cache
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 714e793d-f078-5897-9aea-f0c00593a977
2026-03-24 16:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 714e793d-f078-5897-9aea-f0c00593a977, skipping ID generation
2026-03-24 16:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714e793d-f078-5897-9aea-f0c00593a977 with scrape type 1
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 714e793d-f078-5897-9aea-f0c00593a977 sending to next pipeline
2026-03-24 16:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 714e793d-f078-5897-9aea-f0c00593a977, identifier: 1980691
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0e1d0>
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/1.jpg saved to cache
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:33 [ayvens.fr] INFO: Found listing with ID: 1980693
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980693%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [ayvens.fr] INFO: Scrape type for 1980693: 1
2026-03-24 16:47:33 [ayvens.fr] INFO: Extracting data for car ID: 1980693
2026-03-24 16:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3d2210-c345-519a-a314-5088e09e94c3 with identifier: 1980693
2026-03-24 16:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3d2210-c345-519a-a314-5088e09e94c3 with scrape type 1
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/1.jpg not downloaded yet
2026-03-24 16:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 714e793d-f078-5897-9aea-f0c00593a977 with identifier: 1980691
2026-03-24 16:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 714e793d-f078-5897-9aea-f0c00593a977 with identifier: 1980691
2026-03-24 16:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 714e793d-f078-5897-9aea-f0c00593a977 with identifier: 1980691 to the API
2026-03-24 16:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '714e793d-f078-5897-9aea-f0c00593a977',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 82323,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_714e793d-f078-5897-9aea-f0c00593a977/714e793d-f078-5897-9aea-f0c00593a977_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d72e9cf34730488785b7f9efe35c52fa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-29',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT PARTNER Partner Standard 650kg BlueHDi 100ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Partner Standard 650kg BlueHDi 100ch S&S Asphalt',
'vin': None,
'year': 2020}
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980691%27 HTTP/1.1" 200 None
2026-03-24 16:47:34 [ayvens.fr] INFO: Saving data for 1980691: {'created_time': 1774370854.53511, 'last_price_update_time': 1774370854.535122, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980691') HTTP/1.1" 204 0
2026-03-24 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/2.jpg not downloaded yet
2026-03-24 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff450>
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/2.jpg saved to cache
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cef150>
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/3.jpg saved to cache
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/3.jpg not downloaded yet
2026-03-24 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/4.jpg not downloaded yet
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6052e50>
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/4.jpg saved to cache
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7ceffd0>
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/6.jpg saved to cache
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/5.jpg not downloaded yet
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/6.jpg not downloaded yet
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570fbd0>
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/5.jpg saved to cache
2026-03-24 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571b6d0>
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/7.jpg saved to cache
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/7.jpg not downloaded yet
2026-03-24 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/8.jpg not downloaded yet
2026-03-24 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:35 [ayvens.fr] INFO: Found listing with ID: 1980694
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980694%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [ayvens.fr] INFO: Scrape type for 1980694: 1
2026-03-24 16:47:35 [ayvens.fr] INFO: Extracting data for car ID: 1980694
2026-03-24 16:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d92626-5eff-57ec-8451-3f9624ae35c1 with identifier: 1980694
2026-03-24 16:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d92626-5eff-57ec-8451-3f9624ae35c1 with scrape type 1
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/1.jpg not downloaded yet
2026-03-24 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/2.jpg not downloaded yet
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/3.jpg not downloaded yet
2026-03-24 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/4.jpg not downloaded yet
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4574bd0>
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fca61dbbfc65643e08e7c94b6f6f3fe5b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/8.jpg saved to cache
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8b00ec4-6426-578c-a85c-f73ed250f370
2026-03-24 16:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8b00ec4-6426-578c-a85c-f73ed250f370, skipping ID generation
2026-03-24 16:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8b00ec4-6426-578c-a85c-f73ed250f370 with scrape type 1
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8b00ec4-6426-578c-a85c-f73ed250f370 sending to next pipeline
2026-03-24 16:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c8b00ec4-6426-578c-a85c-f73ed250f370, identifier: 1980692
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457f810>
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/1.jpg saved to cache
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/5.jpg not downloaded yet
2026-03-24 16:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c8b00ec4-6426-578c-a85c-f73ed250f370 with identifier: 1980692
2026-03-24 16:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c8b00ec4-6426-578c-a85c-f73ed250f370 with identifier: 1980692
2026-03-24 16:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c8b00ec4-6426-578c-a85c-f73ed250f370 with identifier: 1980692 to the API
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 191,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c8b00ec4-6426-578c-a85c-f73ed250f370',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 99168,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b00ec4-6426-578c-a85c-f73ed250f370/c8b00ec4-6426-578c-a85c-f73ed250f370_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/ca61dbbfc65643e08e7c94b6f6f3fe5b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-12',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L1H1 1000 2.0 dCi 120ch Grand Confort',
'transmission': 'manual',
'trim': 'Trafic Fg L1H1 1000 2.0 dCi 120ch Grand Confort',
'vin': None,
'year': 2021}
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980692%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [ayvens.fr] INFO: Saving data for 1980692: {'created_time': 1774370856.050219, 'last_price_update_time': 1774370856.050231, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980692') HTTP/1.1" 204 0
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7e150>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/2.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/6.jpg not downloaded yet
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/7.jpg not downloaded yet
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7eddc50>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/4.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bbf50>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/3.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/8.jpg not downloaded yet
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:36 [ayvens.fr] INFO: Found listing with ID: 1980695
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980695%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [ayvens.fr] INFO: Scrape type for 1980695: 1
2026-03-24 16:47:36 [ayvens.fr] INFO: Extracting data for car ID: 1980695
2026-03-24 16:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99afe5fe-1dfe-52bd-b406-dbb916e00b32 with identifier: 1980695
2026-03-24 16:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32 with scrape type 1
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/1.jpg not downloaded yet
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d1550>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/6.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/2.jpg not downloaded yet
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc0fd0>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/7.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e328d0>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/1.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56ff610>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/8.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce24d0>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/2.jpg saved to cache
2026-03-24 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d13ed0>
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F7688465b1982433ca6cc3abde9d3a2bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/5.jpg saved to cache
2026-03-24 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa3d2210-c345-519a-a314-5088e09e94c3
2026-03-24 16:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa3d2210-c345-519a-a314-5088e09e94c3, skipping ID generation
2026-03-24 16:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3d2210-c345-519a-a314-5088e09e94c3 with scrape type 1
2026-03-24 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa3d2210-c345-519a-a314-5088e09e94c3 sending to next pipeline
2026-03-24 16:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fa3d2210-c345-519a-a314-5088e09e94c3, identifier: 1980693
2026-03-24 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cfb190>
2026-03-24 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/3.jpg saved to cache
2026-03-24 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/3.jpg not downloaded yet
2026-03-24 16:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fa3d2210-c345-519a-a314-5088e09e94c3 with identifier: 1980693
2026-03-24 16:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fa3d2210-c345-519a-a314-5088e09e94c3 with identifier: 1980693
2026-03-24 16:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fa3d2210-c345-519a-a314-5088e09e94c3 with identifier: 1980693 to the API
2026-03-24 16:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'fa3d2210-c345-519a-a314-5088e09e94c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'E-TRANSIT',
'odometer': 16829,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335429,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3d2210-c345-519a-a314-5088e09e94c3/fa3d2210-c345-519a-a314-5088e09e94c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/7688465b1982433ca6cc3abde9d3a2bf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-31',
'seats_number': 3,
'seller_name': None,
'title': 'FORD E-TRANSIT Transit 2T Fg PE 350 L2H2 198 kW Batterie 75/68 kWh '
'Trend Business - 3T9 VITESSE LIMITEE A 90//OK PERMIS B',
'transmission': 'automatic',
'trim': 'Transit 2T Fg PE 350 L2H2 198 kW Batterie 75/68 kWh Trend Business - '
'3T9 VITESSE LIMITEE A 90//OK PERMIS B',
'vin': None,
'year': 2023}
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980693%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [ayvens.fr] INFO: Saving data for 1980693: {'created_time': 1774370858.137546, 'last_price_update_time': 1774370858.13756, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980693') HTTP/1.1" 204 0
2026-03-24 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/4.jpg not downloaded yet
2026-03-24 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8910>
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/4.jpg saved to cache
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/5.jpg not downloaded yet
2026-03-24 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/6.jpg not downloaded yet
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d12390>
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/6.jpg saved to cache
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/7.jpg not downloaded yet
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/8.jpg not downloaded yet
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddcd10>
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/5.jpg saved to cache
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fcf10>
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/7.jpg saved to cache
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df8850>
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F2949e7e9a4dc4b21b3b9a6d25c2b387f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/8.jpg saved to cache
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8d92626-5eff-57ec-8451-3f9624ae35c1
2026-03-24 16:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8d92626-5eff-57ec-8451-3f9624ae35c1, skipping ID generation
2026-03-24 16:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d92626-5eff-57ec-8451-3f9624ae35c1 with scrape type 1
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8d92626-5eff-57ec-8451-3f9624ae35c1 sending to next pipeline
2026-03-24 16:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c8d92626-5eff-57ec-8451-3f9624ae35c1, identifier: 1980694
2026-03-24 16:47:38 [ayvens.fr] INFO: Found listing with ID: 1980696
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980696%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [ayvens.fr] INFO: Scrape type for 1980696: 1
2026-03-24 16:47:38 [ayvens.fr] INFO: Extracting data for car ID: 1980696
2026-03-24 16:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a8247f4-e748-5b2a-866f-30424324e5c9 with identifier: 1980696
2026-03-24 16:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8247f4-e748-5b2a-866f-30424324e5c9 with scrape type 1
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/1.jpg not downloaded yet
2026-03-24 16:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c8d92626-5eff-57ec-8451-3f9624ae35c1 with identifier: 1980694
2026-03-24 16:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c8d92626-5eff-57ec-8451-3f9624ae35c1 with identifier: 1980694
2026-03-24 16:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c8d92626-5eff-57ec-8451-3f9624ae35c1 with identifier: 1980694 to the API
2026-03-24 16:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'c8d92626-5eff-57ec-8451-3f9624ae35c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 61568,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8d92626-5eff-57ec-8451-3f9624ae35c1/c8d92626-5eff-57ec-8451-3f9624ae35c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/2949e7e9a4dc4b21b3b9a6d25c2b387f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-09',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 208 208 Affaire 1.2 PureTech 75ch S&S Premium Pack',
'transmission': 'manual',
'trim': '208 Affaire 1.2 PureTech 75ch S&S Premium Pack',
'vin': None,
'year': 2021}
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980694%27 HTTP/1.1" 200 None
2026-03-24 16:47:39 [ayvens.fr] INFO: Saving data for 1980694: {'created_time': 1774370859.833315, 'last_price_update_time': 1774370859.83333, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980694') HTTP/1.1" 204 0
2026-03-24 16:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/2.jpg not downloaded yet
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf2590>
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/1.jpg saved to cache
2026-03-24 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/3.jpg not downloaded yet
2026-03-24 16:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/4.jpg not downloaded yet
2026-03-24 16:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba1b90>
2026-03-24 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/2.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/5.jpg not downloaded yet
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/6.jpg not downloaded yet
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570ae90>
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/4.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/7.jpg not downloaded yet
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd7210>
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/6.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf39d0>
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/7.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/8.jpg not downloaded yet
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c798d0>
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/5.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d12810>
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/3.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:40 [ayvens.fr] INFO: Found listing with ID: 1980697
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980697%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [ayvens.fr] INFO: Scrape type for 1980697: 1
2026-03-24 16:47:40 [ayvens.fr] INFO: Extracting data for car ID: 1980697
2026-03-24 16:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4210b111-6309-5d7a-a8d1-30fba77b213d with identifier: 1980697
2026-03-24 16:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4210b111-6309-5d7a-a8d1-30fba77b213d with scrape type 1
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/1.jpg not downloaded yet
2026-03-24 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/2.jpg not downloaded yet
2026-03-24 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718050>
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F26baa48fdbc44e5f868b4fdcfce615f6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/8.jpg saved to cache
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32
2026-03-24 16:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99afe5fe-1dfe-52bd-b406-dbb916e00b32, skipping ID generation
2026-03-24 16:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32 with scrape type 1
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99afe5fe-1dfe-52bd-b406-dbb916e00b32 sending to next pipeline
2026-03-24 16:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 99afe5fe-1dfe-52bd-b406-dbb916e00b32, identifier: 1980695
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/3.jpg not downloaded yet
2026-03-24 16:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 99afe5fe-1dfe-52bd-b406-dbb916e00b32 with identifier: 1980695
2026-03-24 16:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 99afe5fe-1dfe-52bd-b406-dbb916e00b32 with identifier: 1980695
2026-03-24 16:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 99afe5fe-1dfe-52bd-b406-dbb916e00b32 with identifier: 1980695 to the API
2026-03-24 16:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '99afe5fe-1dfe-52bd-b406-dbb916e00b32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'E-TRANSIT',
'odometer': 18181,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99afe5fe-1dfe-52bd-b406-dbb916e00b32/99afe5fe-1dfe-52bd-b406-dbb916e00b32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/26baa48fdbc44e5f868b4fdcfce615f6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-07',
'seats_number': 3,
'seller_name': None,
'title': 'FORD E-TRANSIT Transit 2T Fg PE 350 L2H2 135 kW Batterie 75/68 kWh '
'Trend Business - 3T9 VITESSE LIMITEE A 90//OK PERMIS B',
'transmission': 'automatic',
'trim': 'Transit 2T Fg PE 350 L2H2 135 kW Batterie 75/68 kWh Trend Business - '
'3T9 VITESSE LIMITEE A 90//OK PERMIS B',
'vin': None,
'year': 2023}
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980695%27 HTTP/1.1" 200 None
2026-03-24 16:47:41 [ayvens.fr] INFO: Saving data for 1980695: {'created_time': 1774370861.525384, 'last_price_update_time': 1774370861.525406, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980695') HTTP/1.1" 204 0
2026-03-24 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/4.jpg not downloaded yet
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571b1d0>
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/2.jpg saved to cache
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ec690>
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/1.jpg saved to cache
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb9b50>
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/4.jpg saved to cache
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6119f10>
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/5.jpg saved to cache
2026-03-24 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/5.jpg not downloaded yet
2026-03-24 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/6.jpg not downloaded yet
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d73890>
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/3.jpg saved to cache
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfa810>
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/6.jpg saved to cache
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/7.jpg not downloaded yet
2026-03-24 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dccf50>
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/7.jpg saved to cache
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/8.jpg not downloaded yet
2026-03-24 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:42 [ayvens.fr] INFO: Found listing with ID: 1980698
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980698%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [ayvens.fr] INFO: Scrape type for 1980698: 1
2026-03-24 16:47:42 [ayvens.fr] INFO: Extracting data for car ID: 1980698
2026-03-24 16:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7737b65b-a275-5c13-9aa5-4404340703d4 with identifier: 1980698
2026-03-24 16:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7737b65b-a275-5c13-9aa5-4404340703d4 with scrape type 1
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/1.jpg not downloaded yet
2026-03-24 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/2.jpg not downloaded yet
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457d410>
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4b8f1d8f1b9f46beb50a7896b844d563%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/8.jpg saved to cache
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a8247f4-e748-5b2a-866f-30424324e5c9
2026-03-24 16:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a8247f4-e748-5b2a-866f-30424324e5c9, skipping ID generation
2026-03-24 16:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8247f4-e748-5b2a-866f-30424324e5c9 with scrape type 1
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a8247f4-e748-5b2a-866f-30424324e5c9 sending to next pipeline
2026-03-24 16:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6a8247f4-e748-5b2a-866f-30424324e5c9, identifier: 1980696
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/3.jpg not downloaded yet
2026-03-24 16:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6a8247f4-e748-5b2a-866f-30424324e5c9 with identifier: 1980696
2026-03-24 16:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6a8247f4-e748-5b2a-866f-30424324e5c9 with identifier: 1980696
2026-03-24 16:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6a8247f4-e748-5b2a-866f-30424324e5c9 with identifier: 1980696 to the API
2026-03-24 16:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '6a8247f4-e748-5b2a-866f-30424324e5c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208 BUSINESS R',
'odometer': 10277,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404756,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404756,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8247f4-e748-5b2a-866f-30424324e5c9/6a8247f4-e748-5b2a-866f-30424324e5c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4b8f1d8f1b9f46beb50a7896b844d563/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-06',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 208 BUSINESS R 208 Business R 1.2 PureTech 100 S&S Active',
'transmission': 'manual',
'trim': '208 Business R 1.2 PureTech 100 S&S Active',
'vin': None,
'year': 2022}
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980696%27 HTTP/1.1" 200 None
2026-03-24 16:47:43 [ayvens.fr] INFO: Saving data for 1980696: {'created_time': 1774370863.75892, 'last_price_update_time': 1774370863.758931, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980696') HTTP/1.1" 204 0
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/4.jpg not downloaded yet
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc5410>
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/2.jpg saved to cache
2026-03-24 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81bd0>
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/1.jpg saved to cache
2026-03-24 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571a5d0>
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/4.jpg saved to cache
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf0290>
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/3.jpg saved to cache
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/5.jpg not downloaded yet
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/6.jpg not downloaded yet
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/7.jpg not downloaded yet
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/8.jpg not downloaded yet
2026-03-24 16:47:44 [ayvens.fr] INFO: Found listing with ID: 1980699
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980699%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [ayvens.fr] INFO: Scrape type for 1980699: 1
2026-03-24 16:47:44 [ayvens.fr] INFO: Extracting data for car ID: 1980699
2026-03-24 16:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ffca73-cd93-5a69-a764-cccff4bd2bd5 with identifier: 1980699
2026-03-24 16:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5 with scrape type 1
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/1.jpg not downloaded yet
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/2.jpg not downloaded yet
2026-03-24 16:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60eedd0>
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/5.jpg saved to cache
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e47350>
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/6.jpg saved to cache
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69390>
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/7.jpg saved to cache
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/3.jpg not downloaded yet
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/4.jpg not downloaded yet
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f6410>
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F043b66bcfc28487894ee093ca1dc291f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/8.jpg saved to cache
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4210b111-6309-5d7a-a8d1-30fba77b213d
2026-03-24 16:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4210b111-6309-5d7a-a8d1-30fba77b213d, skipping ID generation
2026-03-24 16:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4210b111-6309-5d7a-a8d1-30fba77b213d with scrape type 1
2026-03-24 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4210b111-6309-5d7a-a8d1-30fba77b213d sending to next pipeline
2026-03-24 16:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4210b111-6309-5d7a-a8d1-30fba77b213d, identifier: 1980697
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79ff590>
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/1.jpg saved to cache
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b3810>
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/2.jpg saved to cache
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6b190>
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/3.jpg saved to cache
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf89d0>
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/4.jpg saved to cache
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4210b111-6309-5d7a-a8d1-30fba77b213d with identifier: 1980697
2026-03-24 16:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4210b111-6309-5d7a-a8d1-30fba77b213d with identifier: 1980697
2026-03-24 16:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4210b111-6309-5d7a-a8d1-30fba77b213d with identifier: 1980697 to the API
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '4210b111-6309-5d7a-a8d1-30fba77b213d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 73611,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346893,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210b111-6309-5d7a-a8d1-30fba77b213d/4210b111-6309-5d7a-a8d1-30fba77b213d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/043b66bcfc28487894ee093ca1dc291f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-07',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'vin': None,
'year': 2021}
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980697%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [ayvens.fr] INFO: Saving data for 1980697: {'created_time': 1774370865.824044, 'last_price_update_time': 1774370865.824059, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980697') HTTP/1.1" 204 0
2026-03-24 16:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/5.jpg not downloaded yet
2026-03-24 16:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/6.jpg not downloaded yet
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/7.jpg not downloaded yet
2026-03-24 16:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/8.jpg not downloaded yet
2026-03-24 16:47:45 [ayvens.fr] INFO: Found listing with ID: 1980700
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980700%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [ayvens.fr] INFO: Scrape type for 1980700: 1
2026-03-24 16:47:45 [ayvens.fr] INFO: Extracting data for car ID: 1980700
2026-03-24 16:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3780f18-b2d6-5620-a119-30ba6e9a5199 with identifier: 1980700
2026-03-24 16:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3780f18-b2d6-5620-a119-30ba6e9a5199 with scrape type 1
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/1.jpg not downloaded yet
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/2.jpg not downloaded yet
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f6810>
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/7.jpg saved to cache
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbbb90>
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/6.jpg saved to cache
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccef90>
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/8.jpg saved to cache
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/3.jpg not downloaded yet
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb8f90>
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0c0d8c6a3b0d42778b623f074d0eaeed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/5.jpg saved to cache
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7737b65b-a275-5c13-9aa5-4404340703d4
2026-03-24 16:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7737b65b-a275-5c13-9aa5-4404340703d4, skipping ID generation
2026-03-24 16:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7737b65b-a275-5c13-9aa5-4404340703d4 with scrape type 1
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7737b65b-a275-5c13-9aa5-4404340703d4 sending to next pipeline
2026-03-24 16:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7737b65b-a275-5c13-9aa5-4404340703d4, identifier: 1980698
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/4.jpg not downloaded yet
2026-03-24 16:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7737b65b-a275-5c13-9aa5-4404340703d4 with identifier: 1980698
2026-03-24 16:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7737b65b-a275-5c13-9aa5-4404340703d4 with identifier: 1980698
2026-03-24 16:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7737b65b-a275-5c13-9aa5-4404340703d4 with identifier: 1980698 to the API
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '7737b65b-a275-5c13-9aa5-4404340703d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 100016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7737b65b-a275-5c13-9aa5-4404340703d4/7737b65b-a275-5c13-9aa5-4404340703d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0c0d8c6a3b0d42778b623f074d0eaeed/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Reversible 1.0 TCe 90ch Evolution',
'transmission': 'manual',
'trim': 'Clio Reversible 1.0 TCe 90ch Evolution',
'vin': None,
'year': 2022}
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980698%27 HTTP/1.1" 200 None
2026-03-24 16:47:46 [ayvens.fr] INFO: Saving data for 1980698: {'created_time': 1774370866.805969, 'last_price_update_time': 1774370866.805979, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980698') HTTP/1.1" 204 0
2026-03-24 16:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/5.jpg not downloaded yet
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e05a10>
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/1.jpg saved to cache
2026-03-24 16:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccd9d0>
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/2.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/6.jpg not downloaded yet
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f4090>
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/5.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d390>
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/3.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c56fd0>
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/4.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/7.jpg not downloaded yet
2026-03-24 16:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/8.jpg not downloaded yet
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45be290>
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/7.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cbbd90>
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/6.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c578d0>
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F2fc10f5837c64df6bc528050968a3cfa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/8.jpg saved to cache
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5
2026-03-24 16:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5ffca73-cd93-5a69-a764-cccff4bd2bd5, skipping ID generation
2026-03-24 16:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5 with scrape type 1
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5ffca73-cd93-5a69-a764-cccff4bd2bd5 sending to next pipeline
2026-03-24 16:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c5ffca73-cd93-5a69-a764-cccff4bd2bd5, identifier: 1980699
2026-03-24 16:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:47 [ayvens.fr] INFO: Found listing with ID: 1980701
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980701%27 HTTP/1.1" 200 None
2026-03-24 16:47:47 [ayvens.fr] INFO: Scrape type for 1980701: 1
2026-03-24 16:47:47 [ayvens.fr] INFO: Extracting data for car ID: 1980701
2026-03-24 16:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58565bf6-a1f2-5971-83b9-899a08c0b36b with identifier: 1980701
2026-03-24 16:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58565bf6-a1f2-5971-83b9-899a08c0b36b with scrape type 1
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/1.jpg not downloaded yet
2026-03-24 16:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c5ffca73-cd93-5a69-a764-cccff4bd2bd5 with identifier: 1980699
2026-03-24 16:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c5ffca73-cd93-5a69-a764-cccff4bd2bd5 with identifier: 1980699
2026-03-24 16:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c5ffca73-cd93-5a69-a764-cccff4bd2bd5 with identifier: 1980699 to the API
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c5ffca73-cd93-5a69-a764-cccff4bd2bd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 47137,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358600,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309255,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ffca73-cd93-5a69-a764-cccff4bd2bd5/c5ffca73-cd93-5a69-a764-cccff4bd2bd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/2fc10f5837c64df6bc528050968a3cfa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-23',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Extra '
'R-Link',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Extra R-Link',
'vin': None,
'year': 2021}
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980699%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [ayvens.fr] INFO: Saving data for 1980699: {'created_time': 1774370868.111526, 'last_price_update_time': 1774370868.111538, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980699') HTTP/1.1" 204 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/2.jpg not downloaded yet
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454f8d0>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/1.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5aa90>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/2.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/3.jpg not downloaded yet
2026-03-24 16:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/4.jpg not downloaded yet
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/5.jpg not downloaded yet
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81510>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/4.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/6.jpg not downloaded yet
2026-03-24 16:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/7.jpg not downloaded yet
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcd710>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/3.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571ba50>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/5.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79f9f90>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/6.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/8.jpg not downloaded yet
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b0cd0>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/7.jpg saved to cache
2026-03-24 16:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75fd0>
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Ffed636fd08554133a8afe297224c1bac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/8.jpg saved to cache
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3780f18-b2d6-5620-a119-30ba6e9a5199
2026-03-24 16:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3780f18-b2d6-5620-a119-30ba6e9a5199, skipping ID generation
2026-03-24 16:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3780f18-b2d6-5620-a119-30ba6e9a5199 with scrape type 1
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3780f18-b2d6-5620-a119-30ba6e9a5199 sending to next pipeline
2026-03-24 16:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e3780f18-b2d6-5620-a119-30ba6e9a5199, identifier: 1980700
2026-03-24 16:47:49 [ayvens.fr] INFO: Found listing with ID: 1980702
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980702%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [ayvens.fr] INFO: Scrape type for 1980702: 1
2026-03-24 16:47:49 [ayvens.fr] INFO: Extracting data for car ID: 1980702
2026-03-24 16:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af0e420-e107-5509-9028-7c578429907d with identifier: 1980702
2026-03-24 16:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af0e420-e107-5509-9028-7c578429907d with scrape type 1
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/1.jpg not downloaded yet
2026-03-24 16:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e3780f18-b2d6-5620-a119-30ba6e9a5199 with identifier: 1980700
2026-03-24 16:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e3780f18-b2d6-5620-a119-30ba6e9a5199 with identifier: 1980700
2026-03-24 16:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e3780f18-b2d6-5620-a119-30ba6e9a5199 with identifier: 1980700 to the API
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'e3780f18-b2d6-5620-a119-30ba6e9a5199',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 62855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486508,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3780f18-b2d6-5620-a119-30ba6e9a5199/e3780f18-b2d6-5620-a119-30ba6e9a5199_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/fed636fd08554133a8afe297224c1bac/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-15',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine Business EAT6 // 2 '
'PLACES - 2 SEATS',
'transmission': 'automatic',
'trim': 'C3 1.2 PureTech 110ch S&S Shine Business EAT6 // 2 PLACES - 2 SEATS',
'vin': None,
'year': 2020}
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980700%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [ayvens.fr] INFO: Saving data for 1980700: {'created_time': 1774370869.503015, 'last_price_update_time': 1774370869.503028, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980700') HTTP/1.1" 204 0
2026-03-24 16:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/2.jpg not downloaded yet
2026-03-24 16:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/3.jpg not downloaded yet
2026-03-24 16:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/4.jpg not downloaded yet
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/5.jpg not downloaded yet
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/6.jpg not downloaded yet
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/7.jpg not downloaded yet
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/8.jpg not downloaded yet
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e33a50>
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/1.jpg saved to cache
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e06910>
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/5.jpg saved to cache
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:49 [ayvens.fr] INFO: Found listing with ID: 1980703
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980703%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [ayvens.fr] INFO: Scrape type for 1980703: 1
2026-03-24 16:47:49 [ayvens.fr] INFO: Extracting data for car ID: 1980703
2026-03-24 16:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a676fa38-f5ed-5b83-a1cf-c01228b00ccc with identifier: 1980703
2026-03-24 16:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc with scrape type 1
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/1.jpg not downloaded yet
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5719b90>
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/3.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bba250>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/2.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7f750>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/4.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454fb90>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/6.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/2.jpg not downloaded yet
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/3.jpg not downloaded yet
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/4.jpg not downloaded yet
2026-03-24 16:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/5.jpg not downloaded yet
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/6.jpg not downloaded yet
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/7.jpg not downloaded yet
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/8.jpg not downloaded yet
2026-03-24 16:47:50 [ayvens.fr] INFO: Found listing with ID: 1980704
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980704%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [ayvens.fr] INFO: Scrape type for 1980704: 1
2026-03-24 16:47:50 [ayvens.fr] INFO: Extracting data for car ID: 1980704
2026-03-24 16:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb1b3c27-3939-548e-a9f4-ebd22e303bb9 with identifier: 1980704
2026-03-24 16:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9 with scrape type 1
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/1.jpg not downloaded yet
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/2.jpg not downloaded yet
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceba10>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/7.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c55c50>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/6.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/3.jpg not downloaded yet
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1a6d0>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/1.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60850>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/2.jpg saved to cache
2026-03-24 16:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60450>
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/5.jpg saved to cache
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5a190>
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/3.jpg saved to cache
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfa610>
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/4.jpg saved to cache
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/4.jpg not downloaded yet
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613ced0>
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd6731cd5faf24bdf9ff31918376817b7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/8.jpg saved to cache
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58565bf6-a1f2-5971-83b9-899a08c0b36b
2026-03-24 16:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58565bf6-a1f2-5971-83b9-899a08c0b36b, skipping ID generation
2026-03-24 16:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58565bf6-a1f2-5971-83b9-899a08c0b36b with scrape type 1
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58565bf6-a1f2-5971-83b9-899a08c0b36b sending to next pipeline
2026-03-24 16:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 58565bf6-a1f2-5971-83b9-899a08c0b36b, identifier: 1980701
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/5.jpg not downloaded yet
2026-03-24 16:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 58565bf6-a1f2-5971-83b9-899a08c0b36b with identifier: 1980701
2026-03-24 16:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 58565bf6-a1f2-5971-83b9-899a08c0b36b with identifier: 1980701
2026-03-24 16:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 58565bf6-a1f2-5971-83b9-899a08c0b36b with identifier: 1980701 to the API
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 268,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '58565bf6-a1f2-5971-83b9-899a08c0b36b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 141700,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58565bf6-a1f2-5971-83b9-899a08c0b36b/58565bf6-a1f2-5971-83b9-899a08c0b36b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d6731cd5faf24bdf9ff31918376817b7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-17',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3500 L2H2 2.3 dCi 135ch Grand Confort',
'transmission': 'manual',
'trim': 'Master Fg F3500 L2H2 2.3 dCi 135ch Grand Confort',
'vin': None,
'year': 2021}
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980701%27 HTTP/1.1" 200 None
2026-03-24 16:47:51 [ayvens.fr] INFO: Saving data for 1980701: {'created_time': 1774370871.911746, 'last_price_update_time': 1774370871.911759, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980701') HTTP/1.1" 204 0
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/6.jpg not downloaded yet
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3c850>
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/8.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf8290>
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/3.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/7.jpg not downloaded yet
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c80050>
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/1.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457dad0>
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3f1a5505eaa643aeabb9cebd30bbfc69%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/7.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5af0e420-e107-5509-9028-7c578429907d
2026-03-24 16:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af0e420-e107-5509-9028-7c578429907d, skipping ID generation
2026-03-24 16:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af0e420-e107-5509-9028-7c578429907d with scrape type 1
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af0e420-e107-5509-9028-7c578429907d sending to next pipeline
2026-03-24 16:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5af0e420-e107-5509-9028-7c578429907d, identifier: 1980702
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf88d0>
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/6.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459f050>
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/5.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a9750>
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/4.jpg saved to cache
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/8.jpg not downloaded yet
2026-03-24 16:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5af0e420-e107-5509-9028-7c578429907d with identifier: 1980702
2026-03-24 16:47:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5af0e420-e107-5509-9028-7c578429907d with identifier: 1980702
2026-03-24 16:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5af0e420-e107-5509-9028-7c578429907d with identifier: 1980702 to the API
2026-03-24 16:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 224,
'color': 'BLANC BANQUISE OPAQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '5af0e420-e107-5509-9028-7c578429907d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPER',
'odometer': 117813,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349350,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af0e420-e107-5509-9028-7c578429907d/5af0e420-e107-5509-9028-7c578429907d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3f1a5505eaa643aeabb9cebd30bbfc69/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-05',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPER Jumper Fg 30 L1H1 2.2 BlueHDi 120 S&S Driver',
'transmission': 'manual',
'trim': 'Jumper Fg 30 L1H1 2.2 BlueHDi 120 S&S Driver',
'vin': None,
'year': 2021}
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980702%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [ayvens.fr] INFO: Saving data for 1980702: {'created_time': 1774370873.149891, 'last_price_update_time': 1774370873.149902, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980702') HTTP/1.1" 204 0
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [ayvens.fr] INFO: Found listing with ID: 1980705
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980705%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [ayvens.fr] INFO: Scrape type for 1980705: 1
2026-03-24 16:47:53 [ayvens.fr] INFO: Extracting data for car ID: 1980705
2026-03-24 16:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 with identifier: 1980705
2026-03-24 16:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 with scrape type 1
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/1.jpg not downloaded yet
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e3d0>
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/2.jpg saved to cache
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6051fd0>
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/7.jpg saved to cache
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/2.jpg not downloaded yet
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e68c0a50>
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F4b14fab69aab4f998a5d640c10a90d16%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/8.jpg saved to cache
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc
2026-03-24 16:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a676fa38-f5ed-5b83-a1cf-c01228b00ccc, skipping ID generation
2026-03-24 16:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc with scrape type 1
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a676fa38-f5ed-5b83-a1cf-c01228b00ccc sending to next pipeline
2026-03-24 16:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a676fa38-f5ed-5b83-a1cf-c01228b00ccc, identifier: 1980703
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/3.jpg not downloaded yet
2026-03-24 16:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a676fa38-f5ed-5b83-a1cf-c01228b00ccc with identifier: 1980703
2026-03-24 16:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a676fa38-f5ed-5b83-a1cf-c01228b00ccc with identifier: 1980703
2026-03-24 16:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a676fa38-f5ed-5b83-a1cf-c01228b00ccc with identifier: 1980703 to the API
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'a676fa38-f5ed-5b83-a1cf-c01228b00ccc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CONNECT VU',
'odometer': 116474,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a676fa38-f5ed-5b83-a1cf-c01228b00ccc/a676fa38-f5ed-5b83-a1cf-c01228b00ccc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/4b14fab69aab4f998a5d640c10a90d16/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-21',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CONNECT VU Transit Connect L2 1.5 EcoBlue 100ch Trend '
'Business Nav',
'transmission': 'manual',
'trim': 'Transit Connect L2 1.5 EcoBlue 100ch Trend Business Nav',
'vin': None,
'year': 2019}
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980703%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [ayvens.fr] INFO: Saving data for 1980703: {'created_time': 1774370873.852543, 'last_price_update_time': 1774370873.852554, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980703') HTTP/1.1" 204 0
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/4.jpg not downloaded yet
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/5.jpg not downloaded yet
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/6.jpg not downloaded yet
2026-03-24 16:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/7.jpg not downloaded yet
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/8.jpg not downloaded yet
2026-03-24 16:47:53 [ayvens.fr] INFO: Found listing with ID: 1980706
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980706%27 HTTP/1.1" 200 None
2026-03-24 16:47:53 [ayvens.fr] INFO: Scrape type for 1980706: 1
2026-03-24 16:47:53 [ayvens.fr] INFO: Extracting data for car ID: 1980706
2026-03-24 16:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b982558-8a49-51b3-a82a-ed6e68474c20 with identifier: 1980706
2026-03-24 16:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b982558-8a49-51b3-a82a-ed6e68474c20 with scrape type 1
2026-03-24 16:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/1.jpg not downloaded yet
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/2.jpg not downloaded yet
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/3.jpg not downloaded yet
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6058910>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/4.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d29310>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/2.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da5f10>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/3.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6127d50>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/5.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d29c50>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/1.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7d190>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/7.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1f050>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/6.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/4.jpg not downloaded yet
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6126150>
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F323c1f82290943e7a993cdbc3f442dad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/8.jpg saved to cache
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9
2026-03-24 16:47:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb1b3c27-3939-548e-a9f4-ebd22e303bb9, skipping ID generation
2026-03-24 16:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9 with scrape type 1
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb1b3c27-3939-548e-a9f4-ebd22e303bb9 sending to next pipeline
2026-03-24 16:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cb1b3c27-3939-548e-a9f4-ebd22e303bb9, identifier: 1980704
2026-03-24 16:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/5.jpg not downloaded yet
2026-03-24 16:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cb1b3c27-3939-548e-a9f4-ebd22e303bb9 with identifier: 1980704
2026-03-24 16:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cb1b3c27-3939-548e-a9f4-ebd22e303bb9 with identifier: 1980704
2026-03-24 16:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cb1b3c27-3939-548e-a9f4-ebd22e303bb9 with identifier: 1980704 to the API
2026-03-24 16:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'cb1b3c27-3939-548e-a9f4-ebd22e303bb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 95653,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1b3c27-3939-548e-a9f4-ebd22e303bb9/cb1b3c27-3939-548e-a9f4-ebd22e303bb9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/323c1f82290943e7a993cdbc3f442dad/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-26',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'vin': None,
'year': 2021}
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980704%27 HTTP/1.1" 200 None
2026-03-24 16:47:55 [ayvens.fr] INFO: Saving data for 1980704: {'created_time': 1774370875.326323, 'last_price_update_time': 1774370875.326335, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980704') HTTP/1.1" 204 0
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/6.jpg not downloaded yet
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0210>
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/4.jpg saved to cache
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/7.jpg not downloaded yet
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7250>
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/5.jpg saved to cache
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b56250>
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/6.jpg saved to cache
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/8.jpg not downloaded yet
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff3d0>
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/1.jpg saved to cache
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454f950>
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/8.jpg saved to cache
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cba5d0>
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/3.jpg saved to cache
2026-03-24 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:55 [ayvens.fr] INFO: Found listing with ID: 1980707
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980707%27 HTTP/1.1" 200 None
2026-03-24 16:47:56 [ayvens.fr] INFO: Scrape type for 1980707: 1
2026-03-24 16:47:56 [ayvens.fr] INFO: Extracting data for car ID: 1980707
2026-03-24 16:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f8c20e3-20b5-58e9-93d8-d8a04664580e with identifier: 1980707
2026-03-24 16:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e with scrape type 1
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/1.jpg not downloaded yet
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfefd0>
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/7.jpg saved to cache
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ed290>
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F20c4438f516e47b084c6429127ca7f6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/2.jpg saved to cache
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97
2026-03-24 16:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97, skipping ID generation
2026-03-24 16:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 with scrape type 1
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 sending to next pipeline
2026-03-24 16:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97, identifier: 1980705
2026-03-24 16:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 with identifier: 1980705
2026-03-24 16:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 with identifier: 1980705
2026-03-24 16:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97 with identifier: 1980705 to the API
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 40504,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97/fe99fedc-6c7b-56ac-b5e5-46e2f4cdde97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/20c4438f516e47b084c6429127ca7f6e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT ZOE Zoe E-Tech Business charge normale R110 Achat Intégral '
'- 2 PLACES / 2 SEATS',
'transmission': 'automatic',
'trim': 'Zoe E-Tech Business charge normale R110 Achat Intégral - 2 PLACES / '
'2 SEATS',
'vin': None,
'year': 2021}
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980705%27 HTTP/1.1" 200 None
2026-03-24 16:47:56 [ayvens.fr] INFO: Saving data for 1980705: {'created_time': 1774370876.69689, 'last_price_update_time': 1774370876.696901, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980705') HTTP/1.1" 204 0
2026-03-24 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/2.jpg not downloaded yet
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc1450>
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/1.jpg saved to cache
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c05590>
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/3.jpg saved to cache
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d85790>
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/2.jpg saved to cache
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/3.jpg not downloaded yet
2026-03-24 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/4.jpg not downloaded yet
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d03fd0>
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/4.jpg saved to cache
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a6b90>
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/5.jpg saved to cache
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/5.jpg not downloaded yet
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/6.jpg not downloaded yet
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454cd90>
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/6.jpg saved to cache
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e619afd0>
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/7.jpg saved to cache
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/7.jpg not downloaded yet
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/8.jpg not downloaded yet
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4cb10>
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F96e28118064746839d2813fb76c0b97a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/8.jpg saved to cache
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b982558-8a49-51b3-a82a-ed6e68474c20
2026-03-24 16:47:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b982558-8a49-51b3-a82a-ed6e68474c20, skipping ID generation
2026-03-24 16:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b982558-8a49-51b3-a82a-ed6e68474c20 with scrape type 1
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b982558-8a49-51b3-a82a-ed6e68474c20 sending to next pipeline
2026-03-24 16:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5b982558-8a49-51b3-a82a-ed6e68474c20, identifier: 1980706
2026-03-24 16:47:57 [ayvens.fr] INFO: Found listing with ID: 1980708
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980708%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [ayvens.fr] INFO: Scrape type for 1980708: 1
2026-03-24 16:47:57 [ayvens.fr] INFO: Extracting data for car ID: 1980708
2026-03-24 16:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e5c681-8db9-55fe-92fc-80202cd9eee2 with identifier: 1980708
2026-03-24 16:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e5c681-8db9-55fe-92fc-80202cd9eee2 with scrape type 1
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/1.jpg not downloaded yet
2026-03-24 16:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5b982558-8a49-51b3-a82a-ed6e68474c20 with identifier: 1980706
2026-03-24 16:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5b982558-8a49-51b3-a82a-ed6e68474c20 with identifier: 1980706
2026-03-24 16:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5b982558-8a49-51b3-a82a-ed6e68474c20 with identifier: 1980706 to the API
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5b982558-8a49-51b3-a82a-ed6e68474c20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 60758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219475,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b982558-8a49-51b3-a82a-ed6e68474c20/5b982558-8a49-51b3-a82a-ed6e68474c20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/96e28118064746839d2813fb76c0b97a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-14',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech hybride 140ch Business - 2 PLACES / 2 '
'SEATS',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech hybride 140ch Business - 2 PLACES / 2 SEATS',
'vin': None,
'year': 2021}
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980706%27 HTTP/1.1" 200 None
2026-03-24 16:47:57 [ayvens.fr] INFO: Saving data for 1980706: {'created_time': 1774370877.956175, 'last_price_update_time': 1774370877.956186, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980706') HTTP/1.1" 204 0
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/2.jpg not downloaded yet
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/3.jpg not downloaded yet
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/4.jpg not downloaded yet
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/5.jpg not downloaded yet
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/6.jpg not downloaded yet
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/7.jpg not downloaded yet
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfff50>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/1.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/8.jpg not downloaded yet
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4cad0>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/2.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6052950>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/3.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da4e50>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/4.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f010>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/5.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e290>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/7.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f090>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/6.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c07390>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/5.jpg saved to cache
2026-03-24 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb9690>
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/1.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f57d0>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F16a2184d5fe04ea3bc2505d0e9a4aeff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/8.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e
2026-03-24 16:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f8c20e3-20b5-58e9-93d8-d8a04664580e, skipping ID generation
2026-03-24 16:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e with scrape type 1
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f8c20e3-20b5-58e9-93d8-d8a04664580e sending to next pipeline
2026-03-24 16:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3f8c20e3-20b5-58e9-93d8-d8a04664580e, identifier: 1980707
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceb690>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/3.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79f9050>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/2.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a5d10>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/4.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5410>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/6.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e68c2150>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/7.jpg saved to cache
2026-03-24 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3f8c20e3-20b5-58e9-93d8-d8a04664580e with identifier: 1980707
2026-03-24 16:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3f8c20e3-20b5-58e9-93d8-d8a04664580e with identifier: 1980707
2026-03-24 16:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3f8c20e3-20b5-58e9-93d8-d8a04664580e with identifier: 1980707 to the API
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3f8c20e3-20b5-58e9-93d8-d8a04664580e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 91035,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f8c20e3-20b5-58e9-93d8-d8a04664580e/3f8c20e3-20b5-58e9-93d8-d8a04664580e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/16a2184d5fe04ea3bc2505d0e9a4aeff/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-14',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech hybride 140ch Business - 2 PLACES / 2 '
'SEATS',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech hybride 140ch Business - 2 PLACES / 2 SEATS',
'vin': None,
'year': 2022}
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980707%27 HTTP/1.1" 200 None
2026-03-24 16:47:59 [ayvens.fr] INFO: Saving data for 1980707: {'created_time': 1774370879.857384, 'last_price_update_time': 1774370879.857396, 'auction_closing_time': 1774605600.0}
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980707') HTTP/1.1" 204 0
2026-03-24 16:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e9496550>
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F4eeeac8693e64eaeb3e48bd1714aaf97%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/8.jpg saved to cache
2026-03-24 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82e5c681-8db9-55fe-92fc-80202cd9eee2
2026-03-24 16:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82e5c681-8db9-55fe-92fc-80202cd9eee2, skipping ID generation
2026-03-24 16:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e5c681-8db9-55fe-92fc-80202cd9eee2 with scrape type 1
2026-03-24 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82e5c681-8db9-55fe-92fc-80202cd9eee2 sending to next pipeline
2026-03-24 16:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 82e5c681-8db9-55fe-92fc-80202cd9eee2, identifier: 1980708
2026-03-24 16:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 82e5c681-8db9-55fe-92fc-80202cd9eee2 with identifier: 1980708
2026-03-24 16:48:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 82e5c681-8db9-55fe-92fc-80202cd9eee2 with identifier: 1980708
2026-03-24 16:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 82e5c681-8db9-55fe-92fc-80202cd9eee2 with identifier: 1980708 to the API
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'SAPHIRSCHWARZ M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '82e5c681-8db9-55fe-92fc-80202cd9eee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 68839,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328957,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456072,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82e5c681-8db9-55fe-92fc-80202cd9eee2/82e5c681-8db9-55fe-92fc-80202cd9eee2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/4eeeac8693e64eaeb3e48bd1714aaf97/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18i 136ch M Sport',
'transmission': 'automatic',
'trim': 'X1 sDrive18i 136ch M Sport',
'vin': None,
'year': 2024}
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980708%27 HTTP/1.1" 200 None
2026-03-24 16:48:00 [ayvens.fr] INFO: Saving data for 1980708: {'created_time': 1774370880.596481, 'last_price_update_time': 1774370880.596495, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980708') HTTP/1.1" 204 0
2026-03-24 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 16:48:02 [ayvens.fr] INFO: Found listing with ID: 1980709
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980709%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [ayvens.fr] INFO: Scrape type for 1980709: 1
2026-03-24 16:48:02 [ayvens.fr] INFO: Extracting data for car ID: 1980709
2026-03-24 16:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060fecf0-db4d-5812-8d52-ec7a3314616c with identifier: 1980709
2026-03-24 16:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060fecf0-db4d-5812-8d52-ec7a3314616c with scrape type 1
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/1.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/2.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/3.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/4.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/5.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/6.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/7.jpg not downloaded yet
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/8.jpg not downloaded yet
2026-03-24 16:48:02 [ayvens.fr] INFO: Found listing with ID: 1980710
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980710%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [ayvens.fr] INFO: Scrape type for 1980710: 1
2026-03-24 16:48:02 [ayvens.fr] INFO: Extracting data for car ID: 1980710
2026-03-24 16:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9b0691-1062-5e50-9769-60af60b5d7ba with identifier: 1980710
2026-03-24 16:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9b0691-1062-5e50-9769-60af60b5d7ba with scrape type 1
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/1.jpg not downloaded yet
2026-03-24 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/2.jpg not downloaded yet
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/3.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/4.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/5.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/6.jpg not downloaded yet
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/7.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/8.jpg not downloaded yet
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ca5410>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/1.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [ayvens.fr] INFO: Found listing with ID: 1980711
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980711%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [ayvens.fr] INFO: Scrape type for 1980711: 1
2026-03-24 16:48:03 [ayvens.fr] INFO: Extracting data for car ID: 1980711
2026-03-24 16:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ba1cf15-0f6d-5273-889e-40063bcf5df4 with identifier: 1980711
2026-03-24 16:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4 with scrape type 1
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/1.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/2.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/3.jpg not downloaded yet
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0e90>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/3.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d93d0>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/4.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3210>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/6.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ce90>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/5.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/4.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/5.jpg not downloaded yet
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6041d90>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/7.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454f750>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/1.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfdad0>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/8.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/6.jpg not downloaded yet
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/7.jpg not downloaded yet
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/8.jpg not downloaded yet
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31490>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/4.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7c50>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/5.jpg saved to cache
2026-03-24 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4cf90>
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/3.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:04 [ayvens.fr] INFO: Found listing with ID: 1980712
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980712%27 HTTP/1.1" 200 None
2026-03-24 16:48:04 [ayvens.fr] INFO: Scrape type for 1980712: 1
2026-03-24 16:48:04 [ayvens.fr] INFO: Extracting data for car ID: 1980712
2026-03-24 16:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a63376a-332a-504a-b7c4-72b80581c2ce with identifier: 1980712
2026-03-24 16:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a63376a-332a-504a-b7c4-72b80581c2ce with scrape type 1
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/1.jpg not downloaded yet
2026-03-24 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/2.jpg not downloaded yet
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9250>
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/6.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b62250>
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/2.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459db10>
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/7.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/3.jpg not downloaded yet
2026-03-24 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/4.jpg not downloaded yet
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b568d0>
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/2.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7b210>
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/1.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053650>
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F52f62b93c49b4b8da9cdc009880d30a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/8.jpg saved to cache
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f9b0691-1062-5e50-9769-60af60b5d7ba
2026-03-24 16:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f9b0691-1062-5e50-9769-60af60b5d7ba, skipping ID generation
2026-03-24 16:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9b0691-1062-5e50-9769-60af60b5d7ba with scrape type 1
2026-03-24 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f9b0691-1062-5e50-9769-60af60b5d7ba sending to next pipeline
2026-03-24 16:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0f9b0691-1062-5e50-9769-60af60b5d7ba, identifier: 1980710
2026-03-24 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/5.jpg not downloaded yet
2026-03-24 16:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0f9b0691-1062-5e50-9769-60af60b5d7ba with identifier: 1980710
2026-03-24 16:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0f9b0691-1062-5e50-9769-60af60b5d7ba with identifier: 1980710
2026-03-24 16:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0f9b0691-1062-5e50-9769-60af60b5d7ba with identifier: 1980710 to the API
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 27,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '0f9b0691-1062-5e50-9769-60af60b5d7ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 38828,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274341,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f9b0691-1062-5e50-9769-60af60b5d7ba/0f9b0691-1062-5e50-9769-60af60b5d7ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/52f62b93c49b4b8da9cdc009880d30a6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Utimate Style Chrome Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Utimate Style Chrome Geartronic',
'vin': None,
'year': 2023}
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980710%27 HTTP/1.1" 200 None
2026-03-24 16:48:05 [ayvens.fr] INFO: Saving data for 1980710: {'created_time': 1774370885.839758, 'last_price_update_time': 1774370885.839769, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980710') HTTP/1.1" 204 0
2026-03-24 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/6.jpg not downloaded yet
2026-03-24 16:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc0410>
2026-03-24 16:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F76e263d8384b470da10234ace172b28e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/2.jpg saved to cache
2026-03-24 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 060fecf0-db4d-5812-8d52-ec7a3314616c
2026-03-24 16:48:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 060fecf0-db4d-5812-8d52-ec7a3314616c, skipping ID generation
2026-03-24 16:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060fecf0-db4d-5812-8d52-ec7a3314616c with scrape type 1
2026-03-24 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 060fecf0-db4d-5812-8d52-ec7a3314616c sending to next pipeline
2026-03-24 16:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 060fecf0-db4d-5812-8d52-ec7a3314616c, identifier: 1980709
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b1990>
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/3.jpg saved to cache
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b86090>
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/4.jpg saved to cache
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3e150>
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/8.jpg saved to cache
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/7.jpg not downloaded yet
2026-03-24 16:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 060fecf0-db4d-5812-8d52-ec7a3314616c with identifier: 1980709
2026-03-24 16:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 060fecf0-db4d-5812-8d52-ec7a3314616c with identifier: 1980709
2026-03-24 16:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 060fecf0-db4d-5812-8d52-ec7a3314616c with identifier: 1980709 to the API
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '060fecf0-db4d-5812-8d52-ec7a3314616c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'IONIQ 5',
'odometer': 31329,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060fecf0-db4d-5812-8d52-ec7a3314616c/060fecf0-db4d-5812-8d52-ec7a3314616c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/76e263d8384b470da10234ace172b28e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI IONIQ 5 Ioniq 5 77 kWh - 229ch Creative',
'transmission': 'automatic',
'trim': 'Ioniq 5 77 kWh - 229ch Creative',
'vin': None,
'year': 2022}
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980709%27 HTTP/1.1" 200 None
2026-03-24 16:48:06 [ayvens.fr] INFO: Saving data for 1980709: {'created_time': 1774370886.629312, 'last_price_update_time': 1774370886.629324, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980709') HTTP/1.1" 204 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/8.jpg not downloaded yet
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d01450>
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/6.jpg saved to cache
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8810>
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/7.jpg saved to cache
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56dba10>
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5b5db1f8a19f43f695011f65608f9928%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/5.jpg saved to cache
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4
2026-03-24 16:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ba1cf15-0f6d-5273-889e-40063bcf5df4, skipping ID generation
2026-03-24 16:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4 with scrape type 1
2026-03-24 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ba1cf15-0f6d-5273-889e-40063bcf5df4 sending to next pipeline
2026-03-24 16:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6ba1cf15-0f6d-5273-889e-40063bcf5df4, identifier: 1980711
2026-03-24 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 102 items (at 35 items/min)
2026-03-24 16:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6ba1cf15-0f6d-5273-889e-40063bcf5df4 with identifier: 1980711
2026-03-24 16:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6ba1cf15-0f6d-5273-889e-40063bcf5df4 with identifier: 1980711
2026-03-24 16:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6ba1cf15-0f6d-5273-889e-40063bcf5df4 with identifier: 1980711 to the API
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 49,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '6ba1cf15-0f6d-5273-889e-40063bcf5df4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 63658,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1cf15-0f6d-5273-889e-40063bcf5df4/6ba1cf15-0f6d-5273-889e-40063bcf5df4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5b5db1f8a19f43f695011f65608f9928/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T5 Recharge 180 + 82ch R-Design DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T5 Recharge 180 + 82ch R-Design DCT 7',
'vin': None,
'year': 2021}
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980711%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [ayvens.fr] INFO: Saving data for 1980711: {'created_time': 1774370887.32842, 'last_price_update_time': 1774370887.328438, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980711') HTTP/1.1" 204 0
2026-03-24 16:48:07 [ayvens.fr] INFO: Found listing with ID: 1980713
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980713%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [ayvens.fr] INFO: Scrape type for 1980713: 1
2026-03-24 16:48:07 [ayvens.fr] INFO: Extracting data for car ID: 1980713
2026-03-24 16:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae7eaefb-4447-5191-a94d-f23b74c50d87 with identifier: 1980713
2026-03-24 16:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae7eaefb-4447-5191-a94d-f23b74c50d87 with scrape type 1
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/1.jpg not downloaded yet
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/2.jpg not downloaded yet
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454e490>
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/1.jpg saved to cache
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1d850>
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/2.jpg saved to cache
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/3.jpg not downloaded yet
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/4.jpg not downloaded yet
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf3850>
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/4.jpg saved to cache
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0e610>
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/3.jpg saved to cache
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/5.jpg not downloaded yet
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/6.jpg not downloaded yet
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454fbd0>
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/5.jpg saved to cache
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4c950>
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/6.jpg saved to cache
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/7.jpg not downloaded yet
2026-03-24 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/8.jpg not downloaded yet
2026-03-24 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd11d0>
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/8.jpg saved to cache
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31f10>
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F09d22b5441484c678b1dcd841f79b980%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/7.jpg saved to cache
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a63376a-332a-504a-b7c4-72b80581c2ce
2026-03-24 16:48:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a63376a-332a-504a-b7c4-72b80581c2ce, skipping ID generation
2026-03-24 16:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a63376a-332a-504a-b7c4-72b80581c2ce with scrape type 1
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a63376a-332a-504a-b7c4-72b80581c2ce sending to next pipeline
2026-03-24 16:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4a63376a-332a-504a-b7c4-72b80581c2ce, identifier: 1980712
2026-03-24 16:48:08 [ayvens.fr] INFO: Found listing with ID: 1980714
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980714%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [ayvens.fr] INFO: Scrape type for 1980714: 1
2026-03-24 16:48:08 [ayvens.fr] INFO: Extracting data for car ID: 1980714
2026-03-24 16:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b5035a-e511-52c8-9464-26bf84289c14 with identifier: 1980714
2026-03-24 16:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b5035a-e511-52c8-9464-26bf84289c14 with scrape type 1
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/1.jpg not downloaded yet
2026-03-24 16:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4a63376a-332a-504a-b7c4-72b80581c2ce with identifier: 1980712
2026-03-24 16:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4a63376a-332a-504a-b7c4-72b80581c2ce with identifier: 1980712
2026-03-24 16:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4a63376a-332a-504a-b7c4-72b80581c2ce with identifier: 1980712 to the API
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '4a63376a-332a-504a-b7c4-72b80581c2ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'C40',
'odometer': 32258,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a63376a-332a-504a-b7c4-72b80581c2ce/4a63376a-332a-504a-b7c4-72b80581c2ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/09d22b5441484c678b1dcd841f79b980/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO C40 C40 Recharge 231ch Plus',
'transmission': 'automatic',
'trim': 'C40 Recharge 231ch Plus',
'vin': None,
'year': 2023}
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980712%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [ayvens.fr] INFO: Saving data for 1980712: {'created_time': 1774370888.642267, 'last_price_update_time': 1774370888.642278, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980712') HTTP/1.1" 204 0
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/2.jpg not downloaded yet
2026-03-24 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56c8ed0>
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/1.jpg saved to cache
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c70c90>
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/2.jpg saved to cache
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/3.jpg not downloaded yet
2026-03-24 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/4.jpg not downloaded yet
2026-03-24 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e610>
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/3.jpg saved to cache
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/5.jpg not downloaded yet
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/6.jpg not downloaded yet
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456c490>
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/6.jpg saved to cache
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f6292690>
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/5.jpg saved to cache
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c68b50>
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/7.jpg saved to cache
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7b1d0>
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/4.jpg saved to cache
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/7.jpg not downloaded yet
2026-03-24 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/8.jpg not downloaded yet
2026-03-24 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:09 [ayvens.fr] INFO: Found listing with ID: 1980715
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980715%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [ayvens.fr] INFO: Scrape type for 1980715: 1
2026-03-24 16:48:09 [ayvens.fr] INFO: Extracting data for car ID: 1980715
2026-03-24 16:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a9c721a-f1e5-5c14-84d3-d94b09332dfd with identifier: 1980715
2026-03-24 16:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd with scrape type 1
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/1.jpg not downloaded yet
2026-03-24 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/2.jpg not downloaded yet
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/3.jpg not downloaded yet
2026-03-24 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/4.jpg not downloaded yet
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56cb1d0>
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6b31a0c3b0214c6c91f030357922096c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/8.jpg saved to cache
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae7eaefb-4447-5191-a94d-f23b74c50d87
2026-03-24 16:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae7eaefb-4447-5191-a94d-f23b74c50d87, skipping ID generation
2026-03-24 16:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae7eaefb-4447-5191-a94d-f23b74c50d87 with scrape type 1
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae7eaefb-4447-5191-a94d-f23b74c50d87 sending to next pipeline
2026-03-24 16:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ae7eaefb-4447-5191-a94d-f23b74c50d87, identifier: 1980713
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/5.jpg not downloaded yet
2026-03-24 16:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ae7eaefb-4447-5191-a94d-f23b74c50d87 with identifier: 1980713
2026-03-24 16:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ae7eaefb-4447-5191-a94d-f23b74c50d87 with identifier: 1980713
2026-03-24 16:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ae7eaefb-4447-5191-a94d-f23b74c50d87 with identifier: 1980713 to the API
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 157,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'ae7eaefb-4447-5191-a94d-f23b74c50d87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 93922,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325641,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae7eaefb-4447-5191-a94d-f23b74c50d87/ae7eaefb-4447-5191-a94d-f23b74c50d87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6b31a0c3b0214c6c91f030357922096c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 D3 AdBlue 150ch R-Design Geartronic 8',
'transmission': 'automatic',
'trim': 'XC40 D3 AdBlue 150ch R-Design Geartronic 8',
'vin': None,
'year': 2020}
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980713%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [ayvens.fr] INFO: Saving data for 1980713: {'created_time': 1774370890.070407, 'last_price_update_time': 1774370890.070423, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980713') HTTP/1.1" 204 0
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d5d0>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/1.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/6.jpg not downloaded yet
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103c10>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/2.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce9890>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/3.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4ced0>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/4.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb7d0>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/5.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/7.jpg not downloaded yet
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f5e50>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/7.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/8.jpg not downloaded yet
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb710>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/6.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [ayvens.fr] INFO: Found listing with ID: 1980716
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980716%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [ayvens.fr] INFO: Scrape type for 1980716: 1
2026-03-24 16:48:10 [ayvens.fr] INFO: Extracting data for car ID: 1980716
2026-03-24 16:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13c0bd7-9162-56fb-915d-304d9980e4ac with identifier: 1980716
2026-03-24 16:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13c0bd7-9162-56fb-915d-304d9980e4ac with scrape type 1
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/1.jpg not downloaded yet
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/2.jpg not downloaded yet
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8bed0>
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd5bc431993b740ea8cc009c8b76cc594%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/8.jpg saved to cache
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74b5035a-e511-52c8-9464-26bf84289c14
2026-03-24 16:48:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74b5035a-e511-52c8-9464-26bf84289c14, skipping ID generation
2026-03-24 16:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b5035a-e511-52c8-9464-26bf84289c14 with scrape type 1
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74b5035a-e511-52c8-9464-26bf84289c14 sending to next pipeline
2026-03-24 16:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 74b5035a-e511-52c8-9464-26bf84289c14, identifier: 1980714
2026-03-24 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/3.jpg not downloaded yet
2026-03-24 16:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 74b5035a-e511-52c8-9464-26bf84289c14 with identifier: 1980714
2026-03-24 16:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 74b5035a-e511-52c8-9464-26bf84289c14 with identifier: 1980714
2026-03-24 16:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 74b5035a-e511-52c8-9464-26bf84289c14 with identifier: 1980714 to the API
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '74b5035a-e511-52c8-9464-26bf84289c14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 44089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b5035a-e511-52c8-9464-26bf84289c14/74b5035a-e511-52c8-9464-26bf84289c14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d5bc431993b740ea8cc009c8b76cc594/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 Recharge 231ch Start EDT',
'transmission': 'automatic',
'trim': 'XC40 Recharge 231ch Start EDT',
'vin': None,
'year': 2023}
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980714%27 HTTP/1.1" 200 None
2026-03-24 16:48:11 [ayvens.fr] INFO: Saving data for 1980714: {'created_time': 1774370891.472688, 'last_price_update_time': 1774370891.472701, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980714') HTTP/1.1" 204 0
2026-03-24 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/4.jpg not downloaded yet
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b0c90>
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/1.jpg saved to cache
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfab50>
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/2.jpg saved to cache
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b56d10>
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/4.jpg saved to cache
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613d490>
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/5.jpg saved to cache
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/5.jpg not downloaded yet
2026-03-24 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/6.jpg not downloaded yet
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c622d0>
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/6.jpg saved to cache
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7790>
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/7.jpg saved to cache
2026-03-24 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/7.jpg not downloaded yet
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/8.jpg not downloaded yet
2026-03-24 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8a650>
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/8.jpg saved to cache
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfdd10>
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe314e0393440405596e91f741fe26871%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/3.jpg saved to cache
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd
2026-03-24 16:48:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a9c721a-f1e5-5c14-84d3-d94b09332dfd, skipping ID generation
2026-03-24 16:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd with scrape type 1
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a9c721a-f1e5-5c14-84d3-d94b09332dfd sending to next pipeline
2026-03-24 16:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3a9c721a-f1e5-5c14-84d3-d94b09332dfd, identifier: 1980715
2026-03-24 16:48:12 [ayvens.fr] INFO: Found listing with ID: 1980717
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980717%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [ayvens.fr] INFO: Scrape type for 1980717: 1
2026-03-24 16:48:12 [ayvens.fr] INFO: Extracting data for car ID: 1980717
2026-03-24 16:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3cfc0a3-dfee-5a17-952c-e653af423394 with identifier: 1980717
2026-03-24 16:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3cfc0a3-dfee-5a17-952c-e653af423394 with scrape type 1
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/1.jpg not downloaded yet
2026-03-24 16:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3a9c721a-f1e5-5c14-84d3-d94b09332dfd with identifier: 1980715
2026-03-24 16:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3a9c721a-f1e5-5c14-84d3-d94b09332dfd with identifier: 1980715
2026-03-24 16:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3a9c721a-f1e5-5c14-84d3-d94b09332dfd with identifier: 1980715 to the API
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '3a9c721a-f1e5-5c14-84d3-d94b09332dfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'C40',
'odometer': 23194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a9c721a-f1e5-5c14-84d3-d94b09332dfd/3a9c721a-f1e5-5c14-84d3-d94b09332dfd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e314e0393440405596e91f741fe26871/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO C40 C40 Recharge 231ch Start',
'transmission': 'automatic',
'trim': 'C40 Recharge 231ch Start',
'vin': None,
'year': 2022}
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980715%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [ayvens.fr] INFO: Saving data for 1980715: {'created_time': 1774370892.699675, 'last_price_update_time': 1774370892.699691, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980715') HTTP/1.1" 204 0
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/2.jpg not downloaded yet
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56be490>
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/1.jpg saved to cache
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a9cd0>
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/2.jpg saved to cache
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/3.jpg not downloaded yet
2026-03-24 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/4.jpg not downloaded yet
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/5.jpg not downloaded yet
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/6.jpg not downloaded yet
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/7.jpg not downloaded yet
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/8.jpg not downloaded yet
2026-03-24 16:48:13 [ayvens.fr] INFO: Found listing with ID: 1980718
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980718%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [ayvens.fr] INFO: Scrape type for 1980718: 1
2026-03-24 16:48:13 [ayvens.fr] INFO: Extracting data for car ID: 1980718
2026-03-24 16:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d366403d-d37a-5d48-b2ef-d64200cebb68 with identifier: 1980718
2026-03-24 16:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d366403d-d37a-5d48-b2ef-d64200cebb68 with scrape type 1
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/1.jpg not downloaded yet
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/2.jpg not downloaded yet
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19cd0>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/4.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/3.jpg not downloaded yet
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b62e90>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/6.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb7410>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/7.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d55050>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/5.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bbd10>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/3.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/4.jpg not downloaded yet
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/5.jpg not downloaded yet
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/6.jpg not downloaded yet
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/7.jpg not downloaded yet
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/8.jpg not downloaded yet
2026-03-24 16:48:13 [ayvens.fr] INFO: Found listing with ID: 1980719
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980719%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [ayvens.fr] INFO: Scrape type for 1980719: 1
2026-03-24 16:48:13 [ayvens.fr] INFO: Extracting data for car ID: 1980719
2026-03-24 16:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6de081ae-3982-5fb0-8d6a-73d157153f64 with identifier: 1980719
2026-03-24 16:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de081ae-3982-5fb0-8d6a-73d157153f64 with scrape type 1
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/1.jpg not downloaded yet
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/2.jpg not downloaded yet
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aa750>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/1.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d31d50>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/4.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c78490>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/2.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba1f10>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/6.jpg saved to cache
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/3.jpg not downloaded yet
2026-03-24 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708150>
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/3.jpg saved to cache
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d01e90>
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/5.jpg saved to cache
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050110>
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc96f4d7c59824d0aa1822083a7262207%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/8.jpg saved to cache
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d13c0bd7-9162-56fb-915d-304d9980e4ac
2026-03-24 16:48:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d13c0bd7-9162-56fb-915d-304d9980e4ac, skipping ID generation
2026-03-24 16:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13c0bd7-9162-56fb-915d-304d9980e4ac with scrape type 1
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d13c0bd7-9162-56fb-915d-304d9980e4ac sending to next pipeline
2026-03-24 16:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d13c0bd7-9162-56fb-915d-304d9980e4ac, identifier: 1980716
2026-03-24 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/4.jpg not downloaded yet
2026-03-24 16:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d13c0bd7-9162-56fb-915d-304d9980e4ac with identifier: 1980716
2026-03-24 16:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d13c0bd7-9162-56fb-915d-304d9980e4ac with identifier: 1980716
2026-03-24 16:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d13c0bd7-9162-56fb-915d-304d9980e4ac with identifier: 1980716 to the API
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 27,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'd13c0bd7-9162-56fb-915d-304d9980e4ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 84383,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d13c0bd7-9162-56fb-915d-304d9980e4ac/d13c0bd7-9162-56fb-915d-304d9980e4ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c96f4d7c59824d0aa1822083a7262207/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Utimate Style Dark Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Utimate Style Dark Geartronic',
'vin': None,
'year': 2023}
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980716%27 HTTP/1.1" 200 None
2026-03-24 16:48:14 [ayvens.fr] INFO: Saving data for 1980716: {'created_time': 1774370894.730151, 'last_price_update_time': 1774370894.730164, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980716') HTTP/1.1" 204 0
2026-03-24 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/5.jpg not downloaded yet
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f4db69d0>
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/7.jpg saved to cache
2026-03-24 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6095c90>
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fba1918b06a444d688f6b71536fbc594e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/8.jpg saved to cache
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3cfc0a3-dfee-5a17-952c-e653af423394
2026-03-24 16:48:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3cfc0a3-dfee-5a17-952c-e653af423394, skipping ID generation
2026-03-24 16:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3cfc0a3-dfee-5a17-952c-e653af423394 with scrape type 1
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3cfc0a3-dfee-5a17-952c-e653af423394 sending to next pipeline
2026-03-24 16:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c3cfc0a3-dfee-5a17-952c-e653af423394, identifier: 1980717
2026-03-24 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c3cfc0a3-dfee-5a17-952c-e653af423394 with identifier: 1980717
2026-03-24 16:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c3cfc0a3-dfee-5a17-952c-e653af423394 with identifier: 1980717
2026-03-24 16:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c3cfc0a3-dfee-5a17-952c-e653af423394 with identifier: 1980717 to the API
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c3cfc0a3-dfee-5a17-952c-e653af423394',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 110404,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3cfc0a3-dfee-5a17-952c-e653af423394/c3cfc0a3-dfee-5a17-952c-e653af423394_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/ba1918b06a444d688f6b71536fbc594e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 D3 AdBlue 150ch Business',
'transmission': 'manual',
'trim': 'XC40 D3 AdBlue 150ch Business',
'vin': None,
'year': 2020}
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980717%27 HTTP/1.1" 200 None
2026-03-24 16:48:15 [ayvens.fr] INFO: Saving data for 1980717: {'created_time': 1774370895.5601, 'last_price_update_time': 1774370895.560111, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980717') HTTP/1.1" 204 0
2026-03-24 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/6.jpg not downloaded yet
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf2110>
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/3.jpg saved to cache
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/7.jpg not downloaded yet
2026-03-24 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570ba90>
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/4.jpg saved to cache
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d9d0>
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/1.jpg saved to cache
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5fed0>
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/7.jpg saved to cache
2026-03-24 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459c9d0>
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/5.jpg saved to cache
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708310>
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/2.jpg saved to cache
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/8.jpg not downloaded yet
2026-03-24 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:16 [ayvens.fr] INFO: Found listing with ID: 1980720
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980720%27 HTTP/1.1" 200 None
2026-03-24 16:48:16 [ayvens.fr] INFO: Scrape type for 1980720: 1
2026-03-24 16:48:16 [ayvens.fr] INFO: Extracting data for car ID: 1980720
2026-03-24 16:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162bf1c0-2887-5994-8047-fb4732076a7e with identifier: 1980720
2026-03-24 16:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162bf1c0-2887-5994-8047-fb4732076a7e with scrape type 1
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/1.jpg not downloaded yet
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b2e50>
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/6.jpg saved to cache
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf4290>
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9c6ad81877bc48bc85bade750b778f53%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/8.jpg saved to cache
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d366403d-d37a-5d48-b2ef-d64200cebb68
2026-03-24 16:48:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d366403d-d37a-5d48-b2ef-d64200cebb68, skipping ID generation
2026-03-24 16:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d366403d-d37a-5d48-b2ef-d64200cebb68 with scrape type 1
2026-03-24 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d366403d-d37a-5d48-b2ef-d64200cebb68 sending to next pipeline
2026-03-24 16:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d366403d-d37a-5d48-b2ef-d64200cebb68, identifier: 1980718
2026-03-24 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d366403d-d37a-5d48-b2ef-d64200cebb68 with identifier: 1980718
2026-03-24 16:48:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d366403d-d37a-5d48-b2ef-d64200cebb68 with identifier: 1980718
2026-03-24 16:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d366403d-d37a-5d48-b2ef-d64200cebb68 with identifier: 1980718 to the API
2026-03-24 16:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'GRIS MAGNETIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'd366403d-d37a-5d48-b2ef-d64200cebb68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 70413,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d366403d-d37a-5d48-b2ef-d64200cebb68/d366403d-d37a-5d48-b2ef-d64200cebb68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9c6ad81877bc48bc85bade750b778f53/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus Active 1.0 EcoBoost 125ch BVA',
'transmission': 'automatic',
'trim': 'Focus Active 1.0 EcoBoost 125ch BVA',
'vin': None,
'year': 2020}
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980718%27 HTTP/1.1" 200 None
2026-03-24 16:48:17 [ayvens.fr] INFO: Saving data for 1980718: {'created_time': 1774370897.364779, 'last_price_update_time': 1774370897.36479, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980718') HTTP/1.1" 204 0
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/2.jpg not downloaded yet
2026-03-24 16:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a6cd0>
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/1.jpg saved to cache
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/3.jpg not downloaded yet
2026-03-24 16:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8207410>
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/2.jpg saved to cache
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/4.jpg not downloaded yet
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7d8ee90>
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/3.jpg saved to cache
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/5.jpg not downloaded yet
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d66890>
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/4.jpg saved to cache
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/6.jpg not downloaded yet
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf51d0>
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/5.jpg saved to cache
2026-03-24 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d03990>
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/6.jpg saved to cache
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454cc90>
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/7.jpg saved to cache
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/7.jpg not downloaded yet
2026-03-24 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/8.jpg not downloaded yet
2026-03-24 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:18 [ayvens.fr] INFO: Found listing with ID: 1980721
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980721%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [ayvens.fr] INFO: Scrape type for 1980721: 1
2026-03-24 16:48:18 [ayvens.fr] INFO: Extracting data for car ID: 1980721
2026-03-24 16:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b80c4779-2a74-5ce7-b96d-0ef98718ac78 with identifier: 1980721
2026-03-24 16:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80c4779-2a74-5ce7-b96d-0ef98718ac78 with scrape type 1
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/1.jpg not downloaded yet
2026-03-24 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/2.jpg not downloaded yet
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/3.jpg not downloaded yet
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/4.jpg not downloaded yet
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6040490>
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F709d0b2f09d44fc28e64a73186b63864%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/8.jpg saved to cache
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6de081ae-3982-5fb0-8d6a-73d157153f64
2026-03-24 16:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6de081ae-3982-5fb0-8d6a-73d157153f64, skipping ID generation
2026-03-24 16:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de081ae-3982-5fb0-8d6a-73d157153f64 with scrape type 1
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6de081ae-3982-5fb0-8d6a-73d157153f64 sending to next pipeline
2026-03-24 16:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6de081ae-3982-5fb0-8d6a-73d157153f64, identifier: 1980719
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/5.jpg not downloaded yet
2026-03-24 16:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6de081ae-3982-5fb0-8d6a-73d157153f64 with identifier: 1980719
2026-03-24 16:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6de081ae-3982-5fb0-8d6a-73d157153f64 with identifier: 1980719
2026-03-24 16:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6de081ae-3982-5fb0-8d6a-73d157153f64 with identifier: 1980719 to the API
2026-03-24 16:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '6de081ae-3982-5fb0-8d6a-73d157153f64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 33323,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430957,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430957,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284070,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de081ae-3982-5fb0-8d6a-73d157153f64/6de081ae-3982-5fb0-8d6a-73d157153f64_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/709d0b2f09d44fc28e64a73186b63864/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-28',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980719%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [ayvens.fr] INFO: Saving data for 1980719: {'created_time': 1774370899.166528, 'last_price_update_time': 1774370899.166539, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980719') HTTP/1.1" 204 0
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3690>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/1.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/6.jpg not downloaded yet
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/7.jpg not downloaded yet
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cef890>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/2.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5caed10>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/3.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56d53d0>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/4.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/8.jpg not downloaded yet
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [ayvens.fr] INFO: Found listing with ID: 1980722
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980722%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [ayvens.fr] INFO: Scrape type for 1980722: 1
2026-03-24 16:48:19 [ayvens.fr] INFO: Extracting data for car ID: 1980722
2026-03-24 16:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 with identifier: 1980722
2026-03-24 16:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 with scrape type 1
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/1.jpg not downloaded yet
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e46350>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/7.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/2.jpg not downloaded yet
2026-03-24 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bba690>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/5.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3ec10>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/1.jpg saved to cache
2026-03-24 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61022d0>
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/8.jpg saved to cache
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3e090>
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/2.jpg saved to cache
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d58250>
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/3.jpg saved to cache
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/3.jpg not downloaded yet
2026-03-24 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b55b50>
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252Fe26bd55692cb4afab150af9b7af6a766%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/6.jpg saved to cache
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 162bf1c0-2887-5994-8047-fb4732076a7e
2026-03-24 16:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 162bf1c0-2887-5994-8047-fb4732076a7e, skipping ID generation
2026-03-24 16:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162bf1c0-2887-5994-8047-fb4732076a7e with scrape type 1
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 162bf1c0-2887-5994-8047-fb4732076a7e sending to next pipeline
2026-03-24 16:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 162bf1c0-2887-5994-8047-fb4732076a7e, identifier: 1980720
2026-03-24 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/4.jpg not downloaded yet
2026-03-24 16:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 162bf1c0-2887-5994-8047-fb4732076a7e with identifier: 1980720
2026-03-24 16:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 162bf1c0-2887-5994-8047-fb4732076a7e with identifier: 1980720
2026-03-24 16:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 162bf1c0-2887-5994-8047-fb4732076a7e with identifier: 1980720 to the API
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS AMAZONITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '162bf1c0-2887-5994-8047-fb4732076a7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '508',
'odometer': 85971,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162bf1c0-2887-5994-8047-fb4732076a7e/162bf1c0-2887-5994-8047-fb4732076a7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/e26bd55692cb4afab150af9b7af6a766/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 508 508 SW HYBRID 225ch GT e-EAT8',
'transmission': 'automatic',
'trim': '508 SW HYBRID 225ch GT e-EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980720%27 HTTP/1.1" 200 None
2026-03-24 16:48:20 [ayvens.fr] INFO: Saving data for 1980720: {'created_time': 1774370900.714686, 'last_price_update_time': 1774370900.714698, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980720') HTTP/1.1" 204 0
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459fb10>
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/4.jpg saved to cache
2026-03-24 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/5.jpg not downloaded yet
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e04350>
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/7.jpg saved to cache
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61008d0>
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/6.jpg saved to cache
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/6.jpg not downloaded yet
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/7.jpg not downloaded yet
2026-03-24 16:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/8.jpg not downloaded yet
2026-03-24 16:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:21 [ayvens.fr] INFO: Found listing with ID: 1980723
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980723%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [ayvens.fr] INFO: Scrape type for 1980723: 1
2026-03-24 16:48:21 [ayvens.fr] INFO: Extracting data for car ID: 1980723
2026-03-24 16:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc68d32-15cd-5db5-9e6a-76ea226a9331 with identifier: 1980723
2026-03-24 16:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331 with scrape type 1
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/1.jpg not downloaded yet
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/2.jpg not downloaded yet
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/3.jpg not downloaded yet
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6146c50>
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/5.jpg saved to cache
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c88b50>
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feeeea5ef72c94ba9992c38e214bab1bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/8.jpg saved to cache
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b80c4779-2a74-5ce7-b96d-0ef98718ac78
2026-03-24 16:48:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b80c4779-2a74-5ce7-b96d-0ef98718ac78, skipping ID generation
2026-03-24 16:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80c4779-2a74-5ce7-b96d-0ef98718ac78 with scrape type 1
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b80c4779-2a74-5ce7-b96d-0ef98718ac78 sending to next pipeline
2026-03-24 16:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b80c4779-2a74-5ce7-b96d-0ef98718ac78, identifier: 1980721
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/4.jpg not downloaded yet
2026-03-24 16:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b80c4779-2a74-5ce7-b96d-0ef98718ac78 with identifier: 1980721
2026-03-24 16:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b80c4779-2a74-5ce7-b96d-0ef98718ac78 with identifier: 1980721
2026-03-24 16:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b80c4779-2a74-5ce7-b96d-0ef98718ac78 with identifier: 1980721 to the API
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 268,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b80c4779-2a74-5ce7-b96d-0ef98718ac78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 66584,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331898,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b80c4779-2a74-5ce7-b96d-0ef98718ac78/b80c4779-2a74-5ce7-b96d-0ef98718ac78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eeeea5ef72c94ba9992c38e214bab1bf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-14',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3300 L1H2 2.3 Blue dCi 135ch Grand '
'Confort Euro6',
'transmission': 'manual',
'trim': 'Master Fg F3300 L1H2 2.3 Blue dCi 135ch Grand Confort Euro6',
'vin': None,
'year': 2021}
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980721%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [ayvens.fr] INFO: Saving data for 1980721: {'created_time': 1774370901.861193, 'last_price_update_time': 1774370901.861204, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980721') HTTP/1.1" 204 0
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/5.jpg not downloaded yet
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/6.jpg not downloaded yet
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e18990>
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/1.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6094c10>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/2.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd6f50>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/3.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/7.jpg not downloaded yet
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/8.jpg not downloaded yet
2026-03-24 16:48:22 [ayvens.fr] INFO: Found listing with ID: 1980724
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980724%27 HTTP/1.1" 200 None
2026-03-24 16:48:22 [ayvens.fr] INFO: Scrape type for 1980724: 1
2026-03-24 16:48:22 [ayvens.fr] INFO: Extracting data for car ID: 1980724
2026-03-24 16:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e920db30-3fc0-56a9-ad97-faed0e5465c6 with identifier: 1980724
2026-03-24 16:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e920db30-3fc0-56a9-ad97-faed0e5465c6 with scrape type 1
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/1.jpg not downloaded yet
2026-03-24 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/2.jpg not downloaded yet
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572c250>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/5.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6097b50>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/4.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e45190>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/6.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbb6d0>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/7.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e44c50>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F135bce00487e44b993215f3b0decc19e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/8.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5
2026-03-24 16:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5, skipping ID generation
2026-03-24 16:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 with scrape type 1
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 sending to next pipeline
2026-03-24 16:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5, identifier: 1980722
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1fd10>
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/1.jpg saved to cache
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/3.jpg not downloaded yet
2026-03-24 16:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 with identifier: 1980722
2026-03-24 16:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 with identifier: 1980722
2026-03-24 16:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5b3304fb-1ab7-553d-aabf-041c7fd6ebd5 with identifier: 1980722 to the API
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 241,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '5b3304fb-1ab7-553d-aabf-041c7fd6ebd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'BOXER',
'odometer': 110711,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3304fb-1ab7-553d-aabf-041c7fd6ebd5/5b3304fb-1ab7-553d-aabf-041c7fd6ebd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/135bce00487e44b993215f3b0decc19e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-26',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT BOXER Boxer Fg 333 L2H2 2.2 BlueHDi S&S 140ch Asphalt',
'transmission': 'manual',
'trim': 'Boxer Fg 333 L2H2 2.2 BlueHDi S&S 140ch Asphalt',
'vin': None,
'year': 2020}
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980722%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [ayvens.fr] INFO: Saving data for 1980722: {'created_time': 1774370903.529567, 'last_price_update_time': 1774370903.529578, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980722') HTTP/1.1" 204 0
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b14d0>
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/2.jpg saved to cache
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/4.jpg not downloaded yet
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56da810>
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/3.jpg saved to cache
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/5.jpg not downloaded yet
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/6.jpg not downloaded yet
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/7.jpg not downloaded yet
2026-03-24 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/8.jpg not downloaded yet
2026-03-24 16:48:23 [ayvens.fr] INFO: Found listing with ID: 1980725
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980725%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [ayvens.fr] INFO: Scrape type for 1980725: 1
2026-03-24 16:48:23 [ayvens.fr] INFO: Extracting data for car ID: 1980725
2026-03-24 16:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1529a4e1-b292-58c9-8350-0162fa6e5acc with identifier: 1980725
2026-03-24 16:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1529a4e1-b292-58c9-8350-0162fa6e5acc with scrape type 1
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/1.jpg not downloaded yet
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/2.jpg not downloaded yet
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/3.jpg not downloaded yet
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d017d0>
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/4.jpg saved to cache
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/4.jpg not downloaded yet
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c60290>
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/5.jpg saved to cache
2026-03-24 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572c790>
2026-03-24 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/6.jpg saved to cache
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dedd50>
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/7.jpg saved to cache
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/5.jpg not downloaded yet
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/6.jpg not downloaded yet
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7fd10>
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/1.jpg saved to cache
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4576990>
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/2.jpg saved to cache
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e079d0>
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fe954abd817964a90b1bc020b9362937b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/8.jpg saved to cache
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331
2026-03-24 16:48:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fc68d32-15cd-5db5-9e6a-76ea226a9331, skipping ID generation
2026-03-24 16:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331 with scrape type 1
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fc68d32-15cd-5db5-9e6a-76ea226a9331 sending to next pipeline
2026-03-24 16:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9fc68d32-15cd-5db5-9e6a-76ea226a9331, identifier: 1980723
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9fc68d32-15cd-5db5-9e6a-76ea226a9331 with identifier: 1980723
2026-03-24 16:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9fc68d32-15cd-5db5-9e6a-76ea226a9331 with identifier: 1980723
2026-03-24 16:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9fc68d32-15cd-5db5-9e6a-76ea226a9331 with identifier: 1980723 to the API
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '9fc68d32-15cd-5db5-9e6a-76ea226a9331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 67472,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354883,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc68d32-15cd-5db5-9e6a-76ea226a9331/9fc68d32-15cd-5db5-9e6a-76ea226a9331_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/e954abd817964a90b1bc020b9362937b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-12',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2020}
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980723%27 HTTP/1.1" 200 None
2026-03-24 16:48:24 [ayvens.fr] INFO: Saving data for 1980723: {'created_time': 1774370904.937511, 'last_price_update_time': 1774370904.937522, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980723') HTTP/1.1" 204 0
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/7.jpg not downloaded yet
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/8.jpg not downloaded yet
2026-03-24 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050850>
2026-03-24 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/4.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e68c2c50>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/8.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:25 [ayvens.fr] INFO: Found listing with ID: 1980726
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980726%27 HTTP/1.1" 200 None
2026-03-24 16:48:25 [ayvens.fr] INFO: Scrape type for 1980726: 1
2026-03-24 16:48:25 [ayvens.fr] INFO: Extracting data for car ID: 1980726
2026-03-24 16:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c with identifier: 1980726
2026-03-24 16:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c with scrape type 1
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/1.jpg not downloaded yet
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/2.jpg not downloaded yet
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0a110>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/5.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3f290>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/6.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611b650>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/3.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e18bd0>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F6bfd42ff623c466db8741ab1acc33925%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/7.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e920db30-3fc0-56a9-ad97-faed0e5465c6
2026-03-24 16:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e920db30-3fc0-56a9-ad97-faed0e5465c6, skipping ID generation
2026-03-24 16:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e920db30-3fc0-56a9-ad97-faed0e5465c6 with scrape type 1
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e920db30-3fc0-56a9-ad97-faed0e5465c6 sending to next pipeline
2026-03-24 16:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e920db30-3fc0-56a9-ad97-faed0e5465c6, identifier: 1980724
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e68c0a50>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/1.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57174d0>
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/2.jpg saved to cache
2026-03-24 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e920db30-3fc0-56a9-ad97-faed0e5465c6 with identifier: 1980724
2026-03-24 16:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e920db30-3fc0-56a9-ad97-faed0e5465c6 with identifier: 1980724
2026-03-24 16:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e920db30-3fc0-56a9-ad97-faed0e5465c6 with identifier: 1980724 to the API
2026-03-24 16:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'e920db30-3fc0-56a9-ad97-faed0e5465c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 89092,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e920db30-3fc0-56a9-ad97-faed0e5465c6/e920db30-3fc0-56a9-ad97-faed0e5465c6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/6bfd42ff623c466db8741ab1acc33925/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-11',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 dCi 110ch Extra R-Link '
'EDC',
'transmission': 'automatic',
'trim': 'Kangoo Express 1.5 dCi 110ch Extra R-Link EDC',
'vin': None,
'year': 2019}
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980724%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [ayvens.fr] INFO: Saving data for 1980724: {'created_time': 1774370906.172243, 'last_price_update_time': 1774370906.172254, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980724') HTTP/1.1" 204 0
2026-03-24 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/3.jpg not downloaded yet
2026-03-24 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c813d0>
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/3.jpg saved to cache
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/4.jpg not downloaded yet
2026-03-24 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/5.jpg not downloaded yet
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8c10>
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/6.jpg saved to cache
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc9150>
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/4.jpg saved to cache
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/6.jpg not downloaded yet
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d55bd0>
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/5.jpg saved to cache
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56ff490>
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/8.jpg saved to cache
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/7.jpg not downloaded yet
2026-03-24 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/8.jpg not downloaded yet
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d58650>
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F26fcf2429dbd48b2915a65fd143eebfc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/7.jpg saved to cache
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1529a4e1-b292-58c9-8350-0162fa6e5acc
2026-03-24 16:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1529a4e1-b292-58c9-8350-0162fa6e5acc, skipping ID generation
2026-03-24 16:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1529a4e1-b292-58c9-8350-0162fa6e5acc with scrape type 1
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1529a4e1-b292-58c9-8350-0162fa6e5acc sending to next pipeline
2026-03-24 16:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1529a4e1-b292-58c9-8350-0162fa6e5acc, identifier: 1980725
2026-03-24 16:48:26 [ayvens.fr] INFO: Found listing with ID: 1980727
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980727%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [ayvens.fr] INFO: Scrape type for 1980727: 1
2026-03-24 16:48:26 [ayvens.fr] INFO: Extracting data for car ID: 1980727
2026-03-24 16:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60fc884b-d6bf-58e8-8226-ca6b6031c509 with identifier: 1980727
2026-03-24 16:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60fc884b-d6bf-58e8-8226-ca6b6031c509 with scrape type 1
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/1.jpg not downloaded yet
2026-03-24 16:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1529a4e1-b292-58c9-8350-0162fa6e5acc with identifier: 1980725
2026-03-24 16:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1529a4e1-b292-58c9-8350-0162fa6e5acc with identifier: 1980725
2026-03-24 16:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1529a4e1-b292-58c9-8350-0162fa6e5acc with identifier: 1980725 to the API
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '1529a4e1-b292-58c9-8350-0162fa6e5acc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 73178,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1529a4e1-b292-58c9-8350-0162fa6e5acc/1529a4e1-b292-58c9-8350-0162fa6e5acc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/26fcf2429dbd48b2915a65fd143eebfc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Ste 1.0 TCe 90ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Ste 1.0 TCe 90ch Air Nav',
'vin': None,
'year': 2021}
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980725%27 HTTP/1.1" 200 None
2026-03-24 16:48:27 [ayvens.fr] INFO: Saving data for 1980725: {'created_time': 1774370907.60118, 'last_price_update_time': 1774370907.601193, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980725') HTTP/1.1" 204 0
2026-03-24 16:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/2.jpg not downloaded yet
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8710>
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/1.jpg saved to cache
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/3.jpg not downloaded yet
2026-03-24 16:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/4.jpg not downloaded yet
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666c490>
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/4.jpg saved to cache
2026-03-24 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aaa50>
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/3.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/5.jpg not downloaded yet
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/6.jpg not downloaded yet
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce84d0>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/2.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6042b50>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/6.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6052110>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/5.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/7.jpg not downloaded yet
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/8.jpg not downloaded yet
2026-03-24 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:28 [ayvens.fr] INFO: Found listing with ID: 1980728
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980728%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [ayvens.fr] INFO: Scrape type for 1980728: 1
2026-03-24 16:48:28 [ayvens.fr] INFO: Extracting data for car ID: 1980728
2026-03-24 16:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3217eefc-6c15-5b64-85d0-4c52b0340273 with identifier: 1980728
2026-03-24 16:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3217eefc-6c15-5b64-85d0-4c52b0340273 with scrape type 1
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/1.jpg not downloaded yet
2026-03-24 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/2.jpg not downloaded yet
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/3.jpg not downloaded yet
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/4.jpg not downloaded yet
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457c090>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/7.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/5.jpg not downloaded yet
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/6.jpg not downloaded yet
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/7.jpg not downloaded yet
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56da210>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fc65f2e1699804eeab416b1697f63232c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/8.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c
2026-03-24 16:48:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c, skipping ID generation
2026-03-24 16:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c with scrape type 1
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c sending to next pipeline
2026-03-24 16:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c, identifier: 1980726
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666edd0>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/2.jpg saved to cache
2026-03-24 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1ef50>
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/1.jpg saved to cache
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459b4d0>
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/4.jpg saved to cache
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e950>
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/3.jpg saved to cache
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c with identifier: 1980726
2026-03-24 16:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c with identifier: 1980726
2026-03-24 16:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c with identifier: 1980726 to the API
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 82249,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c/0bdaba1a-bd7d-5f58-a9dc-44cb32b5f99c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/c65f2e1699804eeab416b1697f63232c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-29',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'vin': None,
'year': 2020}
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980726%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [ayvens.fr] INFO: Saving data for 1980726: {'created_time': 1774370909.844419, 'last_price_update_time': 1774370909.844431, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980726') HTTP/1.1" 204 0
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/8.jpg not downloaded yet
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [ayvens.fr] INFO: Found listing with ID: 1980729
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980729%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [ayvens.fr] INFO: Scrape type for 1980729: 1
2026-03-24 16:48:29 [ayvens.fr] INFO: Extracting data for car ID: 1980729
2026-03-24 16:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5a64713-992a-584c-bfa0-e39b29e25b96 with identifier: 1980729
2026-03-24 16:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5a64713-992a-584c-bfa0-e39b29e25b96 with scrape type 1
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/1.jpg not downloaded yet
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/2.jpg not downloaded yet
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/3.jpg not downloaded yet
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/4.jpg not downloaded yet
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/5.jpg not downloaded yet
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/6.jpg not downloaded yet
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da7e50>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/6.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4d850>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/5.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459b110>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/1.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56c8990>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/7.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/7.jpg not downloaded yet
2026-03-24 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/8.jpg not downloaded yet
2026-03-24 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:30 [ayvens.fr] INFO: Found listing with ID: 1980730
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980730%27 HTTP/1.1" 200 None
2026-03-24 16:48:30 [ayvens.fr] INFO: Scrape type for 1980730: 1
2026-03-24 16:48:30 [ayvens.fr] INFO: Extracting data for car ID: 1980730
2026-03-24 16:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c134cb-8c14-51dd-af52-22d48fb92f85 with identifier: 1980730
2026-03-24 16:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c134cb-8c14-51dd-af52-22d48fb92f85 with scrape type 1
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/1.jpg not downloaded yet
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459a5d0>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F4136d114b73e49b28141bc2c412562aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/8.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60fc884b-d6bf-58e8-8226-ca6b6031c509
2026-03-24 16:48:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60fc884b-d6bf-58e8-8226-ca6b6031c509, skipping ID generation
2026-03-24 16:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60fc884b-d6bf-58e8-8226-ca6b6031c509 with scrape type 1
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60fc884b-d6bf-58e8-8226-ca6b6031c509 sending to next pipeline
2026-03-24 16:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 60fc884b-d6bf-58e8-8226-ca6b6031c509, identifier: 1980727
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573b9d0>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/3.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dde5d0>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/2.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2d90>
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/4.jpg saved to cache
2026-03-24 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 60fc884b-d6bf-58e8-8226-ca6b6031c509 with identifier: 1980727
2026-03-24 16:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 60fc884b-d6bf-58e8-8226-ca6b6031c509 with identifier: 1980727
2026-03-24 16:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 60fc884b-d6bf-58e8-8226-ca6b6031c509 with identifier: 1980727 to the API
2026-03-24 16:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '60fc884b-d6bf-58e8-8226-ca6b6031c509',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 40956,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269424,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fc884b-d6bf-58e8-8226-ca6b6031c509/60fc884b-d6bf-58e8-8226-ca6b6031c509_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346429,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/4136d114b73e49b28141bc2c412562aa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R - TRANSFO '
'5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2019}
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980727%27 HTTP/1.1" 200 None
2026-03-24 16:48:31 [ayvens.fr] INFO: Saving data for 1980727: {'created_time': 1774370911.440815, 'last_price_update_time': 1774370911.440825, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980727') HTTP/1.1" 204 0
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/2.jpg not downloaded yet
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/3.jpg not downloaded yet
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1df50>
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/5.jpg saved to cache
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddcb10>
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/7.jpg saved to cache
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6043650>
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/4.jpg saved to cache
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/4.jpg not downloaded yet
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/5.jpg not downloaded yet
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddc590>
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/6.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1e50>
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/2.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d79d0>
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/1.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce0290>
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/3.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/6.jpg not downloaded yet
2026-03-24 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b0690>
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fde61d454f9674960943e4ee4c0f8b2cd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/8.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3217eefc-6c15-5b64-85d0-4c52b0340273
2026-03-24 16:48:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3217eefc-6c15-5b64-85d0-4c52b0340273, skipping ID generation
2026-03-24 16:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3217eefc-6c15-5b64-85d0-4c52b0340273 with scrape type 1
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3217eefc-6c15-5b64-85d0-4c52b0340273 sending to next pipeline
2026-03-24 16:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3217eefc-6c15-5b64-85d0-4c52b0340273, identifier: 1980728
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4fd90>
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/5.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4575410>
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/6.jpg saved to cache
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/7.jpg not downloaded yet
2026-03-24 16:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3217eefc-6c15-5b64-85d0-4c52b0340273 with identifier: 1980728
2026-03-24 16:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3217eefc-6c15-5b64-85d0-4c52b0340273 with identifier: 1980728
2026-03-24 16:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3217eefc-6c15-5b64-85d0-4c52b0340273 with identifier: 1980728 to the API
2026-03-24 16:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '3217eefc-6c15-5b64-85d0-4c52b0340273',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4',
'odometer': 96189,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324041,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3217eefc-6c15-5b64-85d0-4c52b0340273/3217eefc-6c15-5b64-85d0-4c52b0340273_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606828,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/de61d454f9674960943e4ee4c0f8b2cd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 C4 Ste 1.5 BlueHDi 110 Feel Nav Business R - TRANSFO 5 '
'PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C4 Ste 1.5 BlueHDi 110 Feel Nav Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2022}
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980728%27 HTTP/1.1" 200 None
2026-03-24 16:48:33 [ayvens.fr] INFO: Saving data for 1980728: {'created_time': 1774370913.152948, 'last_price_update_time': 1774370913.152961, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980728') HTTP/1.1" 204 0
2026-03-24 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/8.jpg not downloaded yet
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6051e50>
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/8.jpg saved to cache
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613da90>
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F32b234e0151d41e49e80fe08bbe78171%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/7.jpg saved to cache
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5a64713-992a-584c-bfa0-e39b29e25b96
2026-03-24 16:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5a64713-992a-584c-bfa0-e39b29e25b96, skipping ID generation
2026-03-24 16:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5a64713-992a-584c-bfa0-e39b29e25b96 with scrape type 1
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5a64713-992a-584c-bfa0-e39b29e25b96 sending to next pipeline
2026-03-24 16:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c5a64713-992a-584c-bfa0-e39b29e25b96, identifier: 1980729
2026-03-24 16:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c5a64713-992a-584c-bfa0-e39b29e25b96 with identifier: 1980729
2026-03-24 16:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c5a64713-992a-584c-bfa0-e39b29e25b96 with identifier: 1980729
2026-03-24 16:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c5a64713-992a-584c-bfa0-e39b29e25b96 with identifier: 1980729 to the API
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'c5a64713-992a-584c-bfa0-e39b29e25b96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 14644,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5a64713-992a-584c-bfa0-e39b29e25b96/c5a64713-992a-584c-bfa0-e39b29e25b96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/32b234e0151d41e49e80fe08bbe78171/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.2 PureTech 83ch Pro Business R - TRANSFO 5 '
'PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Ste 1.2 PureTech 83ch Pro Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2024}
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980729%27 HTTP/1.1" 200 None
2026-03-24 16:48:33 [ayvens.fr] INFO: Saving data for 1980729: {'created_time': 1774370913.806587, 'last_price_update_time': 1774370913.806599, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980729') HTTP/1.1" 204 0
2026-03-24 16:48:33 [ayvens.fr] INFO: Found listing with ID: 1980731
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980731%27 HTTP/1.1" 200 None
2026-03-24 16:48:33 [ayvens.fr] INFO: Scrape type for 1980731: 1
2026-03-24 16:48:33 [ayvens.fr] INFO: Extracting data for car ID: 1980731
2026-03-24 16:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78ea9e59-f506-521b-9e50-dd946fc8dba2 with identifier: 1980731
2026-03-24 16:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78ea9e59-f506-521b-9e50-dd946fc8dba2 with scrape type 1
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/1.jpg not downloaded yet
2026-03-24 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad390>
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/1.jpg saved to cache
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/2.jpg not downloaded yet
2026-03-24 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/3.jpg not downloaded yet
2026-03-24 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050c90>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/3.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724c90>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/2.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/4.jpg not downloaded yet
2026-03-24 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/5.jpg not downloaded yet
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6094ad0>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/4.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b94d0>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/6.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fc210>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/5.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/6.jpg not downloaded yet
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/7.jpg not downloaded yet
2026-03-24 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0fa90>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/7.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/8.jpg not downloaded yet
2026-03-24 16:48:34 [ayvens.fr] INFO: Found listing with ID: 1980732
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980732%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [ayvens.fr] INFO: Scrape type for 1980732: 1
2026-03-24 16:48:34 [ayvens.fr] INFO: Extracting data for car ID: 1980732
2026-03-24 16:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc148ac-183d-5e8f-a089-65968d5990fa with identifier: 1980732
2026-03-24 16:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc148ac-183d-5e8f-a089-65968d5990fa with scrape type 1
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/1.jpg not downloaded yet
2026-03-24 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617c6d0>
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F07b536f34cd34de9a0a23388db88f6c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/8.jpg saved to cache
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95c134cb-8c14-51dd-af52-22d48fb92f85
2026-03-24 16:48:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95c134cb-8c14-51dd-af52-22d48fb92f85, skipping ID generation
2026-03-24 16:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c134cb-8c14-51dd-af52-22d48fb92f85 with scrape type 1
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95c134cb-8c14-51dd-af52-22d48fb92f85 sending to next pipeline
2026-03-24 16:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 95c134cb-8c14-51dd-af52-22d48fb92f85, identifier: 1980730
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/2.jpg not downloaded yet
2026-03-24 16:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 95c134cb-8c14-51dd-af52-22d48fb92f85 with identifier: 1980730
2026-03-24 16:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 95c134cb-8c14-51dd-af52-22d48fb92f85 with identifier: 1980730
2026-03-24 16:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 95c134cb-8c14-51dd-af52-22d48fb92f85 with identifier: 1980730 to the API
2026-03-24 16:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '95c134cb-8c14-51dd-af52-22d48fb92f85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 31579,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c134cb-8c14-51dd-af52-22d48fb92f85/95c134cb-8c14-51dd-af52-22d48fb92f85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/07b536f34cd34de9a0a23388db88f6c3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.2 PureTech 83ch Pro Business R - TRANSFO 5 '
'PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Sté 1.2 PureTech 83ch Pro Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2024}
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980730%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [ayvens.fr] INFO: Saving data for 1980730: {'created_time': 1774370915.322611, 'last_price_update_time': 1774370915.322623, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980730') HTTP/1.1" 204 0
2026-03-24 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621ff50>
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/1.jpg saved to cache
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/3.jpg not downloaded yet
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570edd0>
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/2.jpg saved to cache
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/4.jpg not downloaded yet
2026-03-24 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf4d90>
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/3.jpg saved to cache
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/5.jpg not downloaded yet
2026-03-24 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/6.jpg not downloaded yet
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84dd0>
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/6.jpg saved to cache
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621fc10>
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/7.jpg saved to cache
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/7.jpg not downloaded yet
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/8.jpg not downloaded yet
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56db310>
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/5.jpg saved to cache
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6101610>
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/4.jpg saved to cache
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60eed10>
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc2c6fb2d56c54131b9442e9cdb9ff9ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/8.jpg saved to cache
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78ea9e59-f506-521b-9e50-dd946fc8dba2
2026-03-24 16:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78ea9e59-f506-521b-9e50-dd946fc8dba2, skipping ID generation
2026-03-24 16:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78ea9e59-f506-521b-9e50-dd946fc8dba2 with scrape type 1
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78ea9e59-f506-521b-9e50-dd946fc8dba2 sending to next pipeline
2026-03-24 16:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 78ea9e59-f506-521b-9e50-dd946fc8dba2, identifier: 1980731
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [ayvens.fr] INFO: Found listing with ID: 1980733
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980733%27 HTTP/1.1" 200 None
2026-03-24 16:48:36 [ayvens.fr] INFO: Scrape type for 1980733: 1
2026-03-24 16:48:36 [ayvens.fr] INFO: Extracting data for car ID: 1980733
2026-03-24 16:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07dfa14c-633a-570b-a377-4b3c7524d941 with identifier: 1980733
2026-03-24 16:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07dfa14c-633a-570b-a377-4b3c7524d941 with scrape type 1
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/1.jpg not downloaded yet
2026-03-24 16:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 78ea9e59-f506-521b-9e50-dd946fc8dba2 with identifier: 1980731
2026-03-24 16:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 78ea9e59-f506-521b-9e50-dd946fc8dba2 with identifier: 1980731
2026-03-24 16:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 78ea9e59-f506-521b-9e50-dd946fc8dba2 with identifier: 1980731 to the API
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '78ea9e59-f506-521b-9e50-dd946fc8dba2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208 BUSINESS R',
'odometer': 29000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea9e59-f506-521b-9e50-dd946fc8dba2/78ea9e59-f506-521b-9e50-dd946fc8dba2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c2c6fb2d56c54131b9442e9cdb9ff9ba/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-208 BUSINESS R 208 Business R e-208 136ch Active Business '
'R - TRANSFO 5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'automatic',
'trim': '208 Business R e-208 136ch Active Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2023}
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980731%27 HTTP/1.1" 200 None
2026-03-24 16:48:36 [ayvens.fr] INFO: Saving data for 1980731: {'created_time': 1774370916.774583, 'last_price_update_time': 1774370916.774594, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980731') HTTP/1.1" 204 0
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/2.jpg not downloaded yet
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459c190>
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/2.jpg saved to cache
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/3.jpg not downloaded yet
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/4.jpg not downloaded yet
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4e350>
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/1.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0710>
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/4.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/5.jpg not downloaded yet
2026-03-24 16:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/6.jpg not downloaded yet
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f2d0>
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/3.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4cd10>
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/6.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceba90>
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/5.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6199d90>
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/7.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/7.jpg not downloaded yet
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/8.jpg not downloaded yet
2026-03-24 16:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08f10>
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F794c8999343c4219a4bb60478f3e0d3c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/8.jpg saved to cache
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fc148ac-183d-5e8f-a089-65968d5990fa
2026-03-24 16:48:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fc148ac-183d-5e8f-a089-65968d5990fa, skipping ID generation
2026-03-24 16:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc148ac-183d-5e8f-a089-65968d5990fa with scrape type 1
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fc148ac-183d-5e8f-a089-65968d5990fa sending to next pipeline
2026-03-24 16:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5fc148ac-183d-5e8f-a089-65968d5990fa, identifier: 1980732
2026-03-24 16:48:37 [ayvens.fr] INFO: Found listing with ID: 1980734
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980734%27 HTTP/1.1" 200 None
2026-03-24 16:48:37 [ayvens.fr] INFO: Scrape type for 1980734: 1
2026-03-24 16:48:37 [ayvens.fr] INFO: Extracting data for car ID: 1980734
2026-03-24 16:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccda6054-f443-5f35-9b2e-aba37d08dc17 with identifier: 1980734
2026-03-24 16:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccda6054-f443-5f35-9b2e-aba37d08dc17 with scrape type 1
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/1.jpg not downloaded yet
2026-03-24 16:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5fc148ac-183d-5e8f-a089-65968d5990fa with identifier: 1980732
2026-03-24 16:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5fc148ac-183d-5e8f-a089-65968d5990fa with identifier: 1980732
2026-03-24 16:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5fc148ac-183d-5e8f-a089-65968d5990fa with identifier: 1980732 to the API
2026-03-24 16:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '5fc148ac-183d-5e8f-a089-65968d5990fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208 BUSINESS R',
'odometer': 55102,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319671,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc148ac-183d-5e8f-a089-65968d5990fa/5fc148ac-183d-5e8f-a089-65968d5990fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288675,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/794c8999343c4219a4bb60478f3e0d3c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 BUSINESS R 208 Business R 1.5 BlueHDi 100ch S&S Active '
'- TRANSFO 5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': '208 Business R 1.5 BlueHDi 100ch S&S Active - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2023}
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980732%27 HTTP/1.1" 200 None
2026-03-24 16:48:38 [ayvens.fr] INFO: Saving data for 1980732: {'created_time': 1774370918.96357, 'last_price_update_time': 1774370918.963582, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980732') HTTP/1.1" 204 0
2026-03-24 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/2.jpg not downloaded yet
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725ed0>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/1.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a05850>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/2.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/3.jpg not downloaded yet
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/4.jpg not downloaded yet
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725ed0>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/4.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/5.jpg not downloaded yet
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08190>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/3.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e04890>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/5.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56ffb50>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/6.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a4f90>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/7.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/6.jpg not downloaded yet
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/7.jpg not downloaded yet
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/8.jpg not downloaded yet
2026-03-24 16:48:39 [ayvens.fr] INFO: Found listing with ID: 1980735
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980735%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [ayvens.fr] INFO: Scrape type for 1980735: 1
2026-03-24 16:48:39 [ayvens.fr] INFO: Extracting data for car ID: 1980735
2026-03-24 16:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0814a04c-47ad-55aa-a98b-781b38d893cf with identifier: 1980735
2026-03-24 16:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0814a04c-47ad-55aa-a98b-781b38d893cf with scrape type 1
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/1.jpg not downloaded yet
2026-03-24 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/2.jpg not downloaded yet
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/3.jpg not downloaded yet
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf2410>
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252Fe766d34acbfd4878a60714bed46b513f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/8.jpg saved to cache
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07dfa14c-633a-570b-a377-4b3c7524d941
2026-03-24 16:48:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07dfa14c-633a-570b-a377-4b3c7524d941, skipping ID generation
2026-03-24 16:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07dfa14c-633a-570b-a377-4b3c7524d941 with scrape type 1
2026-03-24 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07dfa14c-633a-570b-a377-4b3c7524d941 sending to next pipeline
2026-03-24 16:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 07dfa14c-633a-570b-a377-4b3c7524d941, identifier: 1980733
2026-03-24 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/4.jpg not downloaded yet
2026-03-24 16:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 07dfa14c-633a-570b-a377-4b3c7524d941 with identifier: 1980733
2026-03-24 16:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 07dfa14c-633a-570b-a377-4b3c7524d941 with identifier: 1980733
2026-03-24 16:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 07dfa14c-633a-570b-a377-4b3c7524d941 with identifier: 1980733 to the API
2026-03-24 16:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '07dfa14c-633a-570b-a377-4b3c7524d941',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 120296,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dfa14c-633a-570b-a377-4b3c7524d941/07dfa14c-633a-570b-a377-4b3c7524d941_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/e766d34acbfd4878a60714bed46b513f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-25',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.5 Blue dCi 85ch Business - 2 PLACES / 2 SEATS',
'transmission': 'manual',
'trim': 'Clio 1.5 Blue dCi 85ch Business - 2 PLACES / 2 SEATS',
'vin': None,
'year': 2020}
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980733%27 HTTP/1.1" 200 None
2026-03-24 16:48:46 [ayvens.fr] INFO: Saving data for 1980733: {'created_time': 1774370926.770735, 'last_price_update_time': 1774370926.770747, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980733') HTTP/1.1" 204 0
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/5.jpg not downloaded yet
2026-03-24 16:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/6.jpg not downloaded yet
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc1950>
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/1.jpg saved to cache
2026-03-24 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e810>
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/2.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33450>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/3.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/7.jpg not downloaded yet
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/8.jpg not downloaded yet
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf8850>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/5.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [ayvens.fr] INFO: Found listing with ID: 1980736
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980736%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [ayvens.fr] INFO: Scrape type for 1980736: 1
2026-03-24 16:48:47 [ayvens.fr] INFO: Extracting data for car ID: 1980736
2026-03-24 16:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00960462-30e4-594d-8535-c7602e13551e with identifier: 1980736
2026-03-24 16:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00960462-30e4-594d-8535-c7602e13551e with scrape type 1
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/1.jpg not downloaded yet
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/2.jpg not downloaded yet
2026-03-24 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8f10>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/7.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1d90>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/6.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a06110>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/4.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7da50>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/1.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19210>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/2.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/3.jpg not downloaded yet
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d619d0>
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F60e47780a72241e4a95cb805529aab11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/8.jpg saved to cache
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccda6054-f443-5f35-9b2e-aba37d08dc17
2026-03-24 16:48:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccda6054-f443-5f35-9b2e-aba37d08dc17, skipping ID generation
2026-03-24 16:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccda6054-f443-5f35-9b2e-aba37d08dc17 with scrape type 1
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccda6054-f443-5f35-9b2e-aba37d08dc17 sending to next pipeline
2026-03-24 16:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ccda6054-f443-5f35-9b2e-aba37d08dc17, identifier: 1980734
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/4.jpg not downloaded yet
2026-03-24 16:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ccda6054-f443-5f35-9b2e-aba37d08dc17 with identifier: 1980734
2026-03-24 16:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ccda6054-f443-5f35-9b2e-aba37d08dc17 with identifier: 1980734
2026-03-24 16:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ccda6054-f443-5f35-9b2e-aba37d08dc17 with identifier: 1980734 to the API
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 34,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'ccda6054-f443-5f35-9b2e-aba37d08dc17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 70458,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446501,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287044,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccda6054-f443-5f35-9b2e-aba37d08dc17/ccda6054-f443-5f35-9b2e-aba37d08dc17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577424,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/60e47780a72241e4a95cb805529aab11/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-11',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.6 E-Tech hybride rechargeable 160ch Intens '
'// 2 PLACES - 2 SEATS',
'transmission': 'automatic',
'trim': 'Captur 1.6 E-Tech hybride rechargeable 160ch Intens // 2 PLACES - 2 '
'SEATS',
'vin': None,
'year': 2021}
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980734%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [ayvens.fr] INFO: Saving data for 1980734: {'created_time': 1774370928.585681, 'last_price_update_time': 1774370928.585693, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980734') HTTP/1.1" 204 0
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666ff50>
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/3.jpg saved to cache
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/5.jpg not downloaded yet
2026-03-24 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/6.jpg not downloaded yet
2026-03-24 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/7.jpg not downloaded yet
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/8.jpg not downloaded yet
2026-03-24 16:48:48 [ayvens.fr] INFO: Found listing with ID: 1980737
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980737%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [ayvens.fr] INFO: Scrape type for 1980737: 1
2026-03-24 16:48:48 [ayvens.fr] INFO: Extracting data for car ID: 1980737
2026-03-24 16:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3bec24b-6a6d-57da-b46b-641e280f289f with identifier: 1980737
2026-03-24 16:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3bec24b-6a6d-57da-b46b-641e280f289f with scrape type 1
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/1.jpg not downloaded yet
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/2.jpg not downloaded yet
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7ced410>
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/4.jpg saved to cache
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e816e010>
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/6.jpg saved to cache
2026-03-24 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6100350>
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/7.jpg saved to cache
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/3.jpg not downloaded yet
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c05d0>
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/5.jpg saved to cache
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/4.jpg not downloaded yet
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/5.jpg not downloaded yet
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ce90>
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0c9555aacd69441eb9d7219e5ba097a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/8.jpg saved to cache
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0814a04c-47ad-55aa-a98b-781b38d893cf
2026-03-24 16:48:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0814a04c-47ad-55aa-a98b-781b38d893cf, skipping ID generation
2026-03-24 16:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0814a04c-47ad-55aa-a98b-781b38d893cf with scrape type 1
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0814a04c-47ad-55aa-a98b-781b38d893cf sending to next pipeline
2026-03-24 16:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0814a04c-47ad-55aa-a98b-781b38d893cf, identifier: 1980735
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5d490>
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/1.jpg saved to cache
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0814a04c-47ad-55aa-a98b-781b38d893cf with identifier: 1980735
2026-03-24 16:48:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0814a04c-47ad-55aa-a98b-781b38d893cf with identifier: 1980735
2026-03-24 16:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0814a04c-47ad-55aa-a98b-781b38d893cf with identifier: 1980735 to the API
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'NOIR ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '0814a04c-47ad-55aa-a98b-781b38d893cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 92051,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483637,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814a04c-47ad-55aa-a98b-781b38d893cf/0814a04c-47ad-55aa-a98b-781b38d893cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0c9555aacd69441eb9d7219e5ba097a0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-23',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Reversible 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio Reversible 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2021}
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980735%27 HTTP/1.1" 200 None
2026-03-24 16:48:49 [ayvens.fr] INFO: Saving data for 1980735: {'created_time': 1774370929.943608, 'last_price_update_time': 1774370929.943624, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980735') HTTP/1.1" 204 0
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/6.jpg not downloaded yet
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/7.jpg not downloaded yet
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457dad0>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/2.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d70a10>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/4.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5719410>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/5.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0750>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/6.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d701d0>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/3.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d73210>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/7.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571a950>
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9a3dce6b60464f578df843fa59f983a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/8.jpg saved to cache
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00960462-30e4-594d-8535-c7602e13551e
2026-03-24 16:48:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00960462-30e4-594d-8535-c7602e13551e, skipping ID generation
2026-03-24 16:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00960462-30e4-594d-8535-c7602e13551e with scrape type 1
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00960462-30e4-594d-8535-c7602e13551e sending to next pipeline
2026-03-24 16:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 00960462-30e4-594d-8535-c7602e13551e, identifier: 1980736
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/8.jpg not downloaded yet
2026-03-24 16:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 00960462-30e4-594d-8535-c7602e13551e with identifier: 1980736
2026-03-24 16:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 00960462-30e4-594d-8535-c7602e13551e with identifier: 1980736
2026-03-24 16:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 00960462-30e4-594d-8535-c7602e13551e with identifier: 1980736 to the API
2026-03-24 16:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '00960462-30e4-594d-8535-c7602e13551e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 50209,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00960462-30e4-594d-8535-c7602e13551e/00960462-30e4-594d-8535-c7602e13551e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9a3dce6b60464f578df843fa59f983a9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-17',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.3 TCe 130ch FAP Intens EDC - 2 PLACES / 2 SEATS',
'transmission': 'automatic',
'trim': 'Clio 1.3 TCe 130ch FAP Intens EDC - 2 PLACES / 2 SEATS',
'vin': None,
'year': 2020}
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980736%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [ayvens.fr] INFO: Saving data for 1980736: {'created_time': 1774370931.142194, 'last_price_update_time': 1774370931.14221, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980736') HTTP/1.1" 204 0
2026-03-24 16:48:51 [ayvens.fr] INFO: Found listing with ID: 1980738
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980738%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [ayvens.fr] INFO: Scrape type for 1980738: 1
2026-03-24 16:48:51 [ayvens.fr] INFO: Extracting data for car ID: 1980738
2026-03-24 16:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5dd670a-7ce0-5080-a640-eb3d60e89121 with identifier: 1980738
2026-03-24 16:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5dd670a-7ce0-5080-a640-eb3d60e89121 with scrape type 1
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/1.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/2.jpg not downloaded yet
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/3.jpg not downloaded yet
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/4.jpg not downloaded yet
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/5.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/6.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/7.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/8.jpg not downloaded yet
2026-03-24 16:48:51 [ayvens.fr] INFO: Found listing with ID: 1980739
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980739%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [ayvens.fr] INFO: Scrape type for 1980739: 1
2026-03-24 16:48:51 [ayvens.fr] INFO: Extracting data for car ID: 1980739
2026-03-24 16:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afef9c0d-f4ad-57d6-8817-a64908608c84 with identifier: 1980739
2026-03-24 16:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afef9c0d-f4ad-57d6-8817-a64908608c84 with scrape type 1
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/1.jpg not downloaded yet
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f2d90>
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/1.jpg saved to cache
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56c8ed0>
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/5.jpg saved to cache
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcee90>
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/3.jpg saved to cache
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8306890>
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/2.jpg saved to cache
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621df10>
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/4.jpg saved to cache
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/2.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/3.jpg not downloaded yet
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/4.jpg not downloaded yet
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/5.jpg not downloaded yet
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/6.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/7.jpg not downloaded yet
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/8.jpg not downloaded yet
2026-03-24 16:48:51 [ayvens.fr] INFO: Found listing with ID: 1980740
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980740%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [ayvens.fr] INFO: Scrape type for 1980740: 1
2026-03-24 16:48:51 [ayvens.fr] INFO: Extracting data for car ID: 1980740
2026-03-24 16:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 with identifier: 1980740
2026-03-24 16:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 with scrape type 1
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/1.jpg not downloaded yet
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da5890>
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/6.jpg saved to cache
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d410>
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/7.jpg saved to cache
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571bfd0>
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/5.jpg saved to cache
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/2.jpg not downloaded yet
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b62810>
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff1616a868e854507912a2722bebd7e92%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/8.jpg saved to cache
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3bec24b-6a6d-57da-b46b-641e280f289f
2026-03-24 16:48:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3bec24b-6a6d-57da-b46b-641e280f289f, skipping ID generation
2026-03-24 16:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3bec24b-6a6d-57da-b46b-641e280f289f with scrape type 1
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3bec24b-6a6d-57da-b46b-641e280f289f sending to next pipeline
2026-03-24 16:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b3bec24b-6a6d-57da-b46b-641e280f289f, identifier: 1980737
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad390>
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/3.jpg saved to cache
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718710>
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/1.jpg saved to cache
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/3.jpg not downloaded yet
2026-03-24 16:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b3bec24b-6a6d-57da-b46b-641e280f289f with identifier: 1980737
2026-03-24 16:48:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b3bec24b-6a6d-57da-b46b-641e280f289f with identifier: 1980737
2026-03-24 16:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b3bec24b-6a6d-57da-b46b-641e280f289f with identifier: 1980737 to the API
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'BLEU ISLAND',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'e85',
'id': 'b3bec24b-6a6d-57da-b46b-641e280f289f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 65578,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3bec24b-6a6d-57da-b46b-641e280f289f/b3bec24b-6a6d-57da-b46b-641e280f289f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f1616a868e854507912a2722bebd7e92/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 Flexifuel 125ch ST-Line',
'transmission': 'manual',
'trim': 'Puma 1.0 Flexifuel 125ch ST-Line',
'vin': None,
'year': 2022}
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980737%27 HTTP/1.1" 200 None
2026-03-24 16:48:53 [ayvens.fr] INFO: Saving data for 1980737: {'created_time': 1774370933.738902, 'last_price_update_time': 1774370933.738914, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980737') HTTP/1.1" 204 0
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/4.jpg not downloaded yet
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b87ad0>
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/2.jpg saved to cache
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8850>
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/4.jpg saved to cache
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/5.jpg not downloaded yet
2026-03-24 16:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/6.jpg not downloaded yet
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc20d0>
2026-03-24 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/8.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724890>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/5.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d12650>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/3.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/7.jpg not downloaded yet
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/8.jpg not downloaded yet
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57159d0>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/4.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456ee50>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/1.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56c9ed0>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/7.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57087d0>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F36ffd465ea594d2780e790e810d4c87c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/6.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5dd670a-7ce0-5080-a640-eb3d60e89121
2026-03-24 16:48:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5dd670a-7ce0-5080-a640-eb3d60e89121, skipping ID generation
2026-03-24 16:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5dd670a-7ce0-5080-a640-eb3d60e89121 with scrape type 1
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5dd670a-7ce0-5080-a640-eb3d60e89121 sending to next pipeline
2026-03-24 16:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b5dd670a-7ce0-5080-a640-eb3d60e89121, identifier: 1980738
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba2350>
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/2.jpg saved to cache
2026-03-24 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b5dd670a-7ce0-5080-a640-eb3d60e89121 with identifier: 1980738
2026-03-24 16:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b5dd670a-7ce0-5080-a640-eb3d60e89121 with identifier: 1980738
2026-03-24 16:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b5dd670a-7ce0-5080-a640-eb3d60e89121 with identifier: 1980738 to the API
2026-03-24 16:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b5dd670a-7ce0-5080-a640-eb3d60e89121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'SPACETOURER',
'odometer': 104756,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430560,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dd670a-7ce0-5080-a640-eb3d60e89121/b5dd670a-7ce0-5080-a640-eb3d60e89121_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/36ffd465ea594d2780e790e810d4c87c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-22',
'seats_number': 9,
'seller_name': None,
'title': 'CITROËN SPACETOURER SpaceTourer M BlueHDi 120ch Business S&S',
'transmission': 'manual',
'trim': 'SpaceTourer M BlueHDi 120ch Business S&S',
'vin': None,
'year': 2019}
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980738%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [ayvens.fr] INFO: Saving data for 1980738: {'created_time': 1774370935.12221, 'last_price_update_time': 1774370935.122222, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980738') HTTP/1.1" 204 0
2026-03-24 16:48:55 [ayvens.fr] INFO: Found listing with ID: 1980741
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980741%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [ayvens.fr] INFO: Scrape type for 1980741: 1
2026-03-24 16:48:55 [ayvens.fr] INFO: Extracting data for car ID: 1980741
2026-03-24 16:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617ae427-5001-582a-b71f-1b24ca628174 with identifier: 1980741
2026-03-24 16:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617ae427-5001-582a-b71f-1b24ca628174 with scrape type 1
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/1.jpg not downloaded yet
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/2.jpg not downloaded yet
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/3.jpg not downloaded yet
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/4.jpg not downloaded yet
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/5.jpg not downloaded yet
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/6.jpg not downloaded yet
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/7.jpg not downloaded yet
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/8.jpg not downloaded yet
2026-03-24 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5715bd0>
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/2.jpg saved to cache
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ee350>
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/6.jpg saved to cache
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddf210>
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/8.jpg saved to cache
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e44150>
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/1.jpg saved to cache
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570e850>
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F731d09c4e28d43db995e1c6ebdf58721%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/7.jpg saved to cache
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afef9c0d-f4ad-57d6-8817-a64908608c84
2026-03-24 16:48:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afef9c0d-f4ad-57d6-8817-a64908608c84, skipping ID generation
2026-03-24 16:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afef9c0d-f4ad-57d6-8817-a64908608c84 with scrape type 1
2026-03-24 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afef9c0d-f4ad-57d6-8817-a64908608c84 sending to next pipeline
2026-03-24 16:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: afef9c0d-f4ad-57d6-8817-a64908608c84, identifier: 1980739
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456ee50>
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/3.jpg saved to cache
2026-03-24 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:56 [ayvens.fr] INFO: Found listing with ID: 1980742
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980742%27 HTTP/1.1" 200 None
2026-03-24 16:48:56 [ayvens.fr] INFO: Scrape type for 1980742: 1
2026-03-24 16:48:56 [ayvens.fr] INFO: Extracting data for car ID: 1980742
2026-03-24 16:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd96ad5-430d-5304-8c0e-31c7a9c74865 with identifier: 1980742
2026-03-24 16:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865 with scrape type 1
2026-03-24 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/1.jpg not downloaded yet
2026-03-24 16:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: afef9c0d-f4ad-57d6-8817-a64908608c84 with identifier: 1980739
2026-03-24 16:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: afef9c0d-f4ad-57d6-8817-a64908608c84 with identifier: 1980739
2026-03-24 16:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: afef9c0d-f4ad-57d6-8817-a64908608c84 with identifier: 1980739 to the API
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'afef9c0d-f4ad-57d6-8817-a64908608c84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS CROSS',
'odometer': 112092,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afef9c0d-f4ad-57d6-8817-a64908608c84/afef9c0d-f4ad-57d6-8817-a64908608c84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/731d09c4e28d43db995e1c6ebdf58721/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS CROSS Yaris Cross 116h Design',
'transmission': 'automatic',
'trim': 'Yaris Cross 116h Design',
'vin': None,
'year': 2024}
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980739%27 HTTP/1.1" 200 None
2026-03-24 16:48:56 [ayvens.fr] INFO: Saving data for 1980739: {'created_time': 1774370936.637352, 'last_price_update_time': 1774370936.637369, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980739') HTTP/1.1" 204 0
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a9710>
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/4.jpg saved to cache
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/2.jpg not downloaded yet
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d30290>
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/5.jpg saved to cache
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf6950>
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/7.jpg saved to cache
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4f450>
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/6.jpg saved to cache
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/3.jpg not downloaded yet
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60710>
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F347c0fd4762b44f9a4b01ea89afa481d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/8.jpg saved to cache
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474
2026-03-24 16:48:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474, skipping ID generation
2026-03-24 16:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 with scrape type 1
2026-03-24 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 sending to next pipeline
2026-03-24 16:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474, identifier: 1980740
2026-03-24 16:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 with identifier: 1980740
2026-03-24 16:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 with identifier: 1980740
2026-03-24 16:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474 with identifier: 1980740 to the API
2026-03-24 16:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 128325,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474/c1aa8fc5-45a2-5aa7-ab46-6728d4ea6474_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/347c0fd4762b44f9a4b01ea89afa481d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.5 BlueHDi 100ch E6.c Active BVM5 5p',
'transmission': 'manual',
'trim': '208 1.5 BlueHDi 100ch E6.c Active BVM5 5p',
'vin': None,
'year': 2019}
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980740%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [ayvens.fr] INFO: Saving data for 1980740: {'created_time': 1774370938.26217, 'last_price_update_time': 1774370938.262181, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980740') HTTP/1.1" 204 0
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/4.jpg not downloaded yet
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/5.jpg not downloaded yet
2026-03-24 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/6.jpg not downloaded yet
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/7.jpg not downloaded yet
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/8.jpg not downloaded yet
2026-03-24 16:48:58 [ayvens.fr] INFO: Found listing with ID: 1980743
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980743%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [ayvens.fr] INFO: Scrape type for 1980743: 1
2026-03-24 16:48:58 [ayvens.fr] INFO: Extracting data for car ID: 1980743
2026-03-24 16:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 with identifier: 1980743
2026-03-24 16:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 with scrape type 1
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/1.jpg not downloaded yet
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/2.jpg not downloaded yet
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d28cd0>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/1.jpg saved to cache
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d55710>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/3.jpg saved to cache
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572c490>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/4.jpg saved to cache
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/3.jpg not downloaded yet
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724c90>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/5.jpg saved to cache
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8a050>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/7.jpg saved to cache
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84d90>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/2.jpg saved to cache
2026-03-24 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8ba50>
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/6.jpg saved to cache
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/4.jpg not downloaded yet
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/5.jpg not downloaded yet
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e450>
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F28f7c148a1a341179005645215057ea4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/8.jpg saved to cache
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 617ae427-5001-582a-b71f-1b24ca628174
2026-03-24 16:48:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 617ae427-5001-582a-b71f-1b24ca628174, skipping ID generation
2026-03-24 16:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617ae427-5001-582a-b71f-1b24ca628174 with scrape type 1
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 617ae427-5001-582a-b71f-1b24ca628174 sending to next pipeline
2026-03-24 16:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 617ae427-5001-582a-b71f-1b24ca628174, identifier: 1980741
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 617ae427-5001-582a-b71f-1b24ca628174 with identifier: 1980741
2026-03-24 16:48:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 617ae427-5001-582a-b71f-1b24ca628174 with identifier: 1980741
2026-03-24 16:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 617ae427-5001-582a-b71f-1b24ca628174 with identifier: 1980741 to the API
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'GRIS PERLE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '617ae427-5001-582a-b71f-1b24ca628174',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 92731,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456641,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617ae427-5001-582a-b71f-1b24ca628174/617ae427-5001-582a-b71f-1b24ca628174_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/28f7c148a1a341179005645215057ea4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV GT-Line Premium Business '
'BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV GT-Line Premium Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980741%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [ayvens.fr] INFO: Saving data for 1980741: {'created_time': 1774370939.63047, 'last_price_update_time': 1774370939.630484, 'auction_closing_time': 1774605600.0}
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980741') HTTP/1.1" 204 0
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/6.jpg not downloaded yet
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/7.jpg not downloaded yet
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666d710>
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/1.jpg saved to cache
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ab310>
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/7.jpg saved to cache
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32610>
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/6.jpg saved to cache
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/8.jpg not downloaded yet
2026-03-24 16:48:59 [ayvens.fr] INFO: Found listing with ID: 1980744
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980744%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [ayvens.fr] INFO: Scrape type for 1980744: 1
2026-03-24 16:48:59 [ayvens.fr] INFO: Extracting data for car ID: 1980744
2026-03-24 16:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1065dec-63e2-5622-9daa-0a8c8b697b23 with identifier: 1980744
2026-03-24 16:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1065dec-63e2-5622-9daa-0a8c8b697b23 with scrape type 1
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/1.jpg not downloaded yet
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8590>
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/4.jpg saved to cache
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454d7d0>
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/5.jpg saved to cache
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d58e90>
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/3.jpg saved to cache
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454d6d0>
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/2.jpg saved to cache
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2a550>
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fbf76f433cf784864bae7b54c03dc1def%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/8.jpg saved to cache
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865
2026-03-24 16:49:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fd96ad5-430d-5304-8c0e-31c7a9c74865, skipping ID generation
2026-03-24 16:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865 with scrape type 1
2026-03-24 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fd96ad5-430d-5304-8c0e-31c7a9c74865 sending to next pipeline
2026-03-24 16:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6fd96ad5-430d-5304-8c0e-31c7a9c74865, identifier: 1980742
2026-03-24 16:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6fd96ad5-430d-5304-8c0e-31c7a9c74865 with identifier: 1980742
2026-03-24 16:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6fd96ad5-430d-5304-8c0e-31c7a9c74865 with identifier: 1980742
2026-03-24 16:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6fd96ad5-430d-5304-8c0e-31c7a9c74865 with identifier: 1980742 to the API
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '6fd96ad5-430d-5304-8c0e-31c7a9c74865',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 57483,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd96ad5-430d-5304-8c0e-31c7a9c74865/6fd96ad5-430d-5304-8c0e-31c7a9c74865_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/bf76f433cf784864bae7b54c03dc1def/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-11',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM Transit Custom Fg 300 L1H1 2.0 EcoBlue 130 '
'Trend Business',
'transmission': 'manual',
'trim': 'Transit Custom Fg 300 L1H1 2.0 EcoBlue 130 Trend Business',
'vin': None,
'year': 2022}
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980742%27 HTTP/1.1" 200 None
2026-03-24 16:49:00 [ayvens.fr] INFO: Saving data for 1980742: {'created_time': 1774370940.963056, 'last_price_update_time': 1774370940.963072, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980742') HTTP/1.1" 204 0
2026-03-24 16:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/2.jpg not downloaded yet
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/3.jpg not downloaded yet
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/4.jpg not downloaded yet
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/5.jpg not downloaded yet
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/6.jpg not downloaded yet
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/7.jpg not downloaded yet
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fb590>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/1.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725ad0>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/2.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/8.jpg not downloaded yet
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [ayvens.fr] INFO: Found listing with ID: 1980745
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980745%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [ayvens.fr] INFO: Scrape type for 1980745: 1
2026-03-24 16:49:01 [ayvens.fr] INFO: Extracting data for car ID: 1980745
2026-03-24 16:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 with identifier: 1980745
2026-03-24 16:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 with scrape type 1
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/1.jpg not downloaded yet
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d350>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/3.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6042f50>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/4.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b8d10>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/7.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2a9d0>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/5.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f6590>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/6.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/2.jpg not downloaded yet
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/3.jpg not downloaded yet
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d6710>
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F5e95b3cab29f49a8893bc2cfcdc16908%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/8.jpg saved to cache
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476
2026-03-24 16:49:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bf9af02-bd9d-52db-b83e-d8a7bca4c476, skipping ID generation
2026-03-24 16:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 with scrape type 1
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 sending to next pipeline
2026-03-24 16:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5bf9af02-bd9d-52db-b83e-d8a7bca4c476, identifier: 1980743
2026-03-24 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/4.jpg not downloaded yet
2026-03-24 16:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 with identifier: 1980743
2026-03-24 16:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 with identifier: 1980743
2026-03-24 16:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5bf9af02-bd9d-52db-b83e-d8a7bca4c476 with identifier: 1980743 to the API
2026-03-24 16:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 195,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '5bf9af02-bd9d-52db-b83e-d8a7bca4c476',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 101644,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468874,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468874,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf9af02-bd9d-52db-b83e-d8a7bca4c476/5bf9af02-bd9d-52db-b83e-d8a7bca4c476_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/5e95b3cab29f49a8893bc2cfcdc16908/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L1H1 1000 1.6 dCi 95ch Grand Confort E6',
'transmission': 'manual',
'trim': 'Trafic Fg L1H1 1000 1.6 dCi 95ch Grand Confort E6',
'vin': None,
'year': 2020}
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980743%27 HTTP/1.1" 200 None
2026-03-24 16:49:02 [ayvens.fr] INFO: Saving data for 1980743: {'created_time': 1774370942.426865, 'last_price_update_time': 1774370942.426876, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980743') HTTP/1.1" 204 0
2026-03-24 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/5.jpg not downloaded yet
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c1050>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/3.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83590>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/1.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c3750>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/4.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83610>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/2.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81610>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/6.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b4490>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/5.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/6.jpg not downloaded yet
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/7.jpg not downloaded yet
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9f50>
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/7.jpg saved to cache
2026-03-24 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/8.jpg not downloaded yet
2026-03-24 16:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:03 [ayvens.fr] INFO: Found listing with ID: 1980746
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980746%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [ayvens.fr] INFO: Scrape type for 1980746: 1
2026-03-24 16:49:03 [ayvens.fr] INFO: Extracting data for car ID: 1980746
2026-03-24 16:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384569fb-707f-5d8f-922c-0bdd1ec950d0 with identifier: 1980746
2026-03-24 16:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384569fb-707f-5d8f-922c-0bdd1ec950d0 with scrape type 1
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/1.jpg not downloaded yet
2026-03-24 16:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/2.jpg not downloaded yet
2026-03-24 16:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/3.jpg not downloaded yet
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/4.jpg not downloaded yet
2026-03-24 16:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/5.jpg not downloaded yet
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613f810>
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/1.jpg saved to cache
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a7290>
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/2.jpg saved to cache
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/6.jpg not downloaded yet
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb5090>
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5d420423f39a4ca59419a786ce30d367%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/8.jpg saved to cache
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1065dec-63e2-5622-9daa-0a8c8b697b23
2026-03-24 16:49:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1065dec-63e2-5622-9daa-0a8c8b697b23, skipping ID generation
2026-03-24 16:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1065dec-63e2-5622-9daa-0a8c8b697b23 with scrape type 1
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1065dec-63e2-5622-9daa-0a8c8b697b23 sending to next pipeline
2026-03-24 16:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e1065dec-63e2-5622-9daa-0a8c8b697b23, identifier: 1980744
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/7.jpg not downloaded yet
2026-03-24 16:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e1065dec-63e2-5622-9daa-0a8c8b697b23 with identifier: 1980744
2026-03-24 16:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e1065dec-63e2-5622-9daa-0a8c8b697b23 with identifier: 1980744
2026-03-24 16:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e1065dec-63e2-5622-9daa-0a8c8b697b23 with identifier: 1980744 to the API
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'e1065dec-63e2-5622-9daa-0a8c8b697b23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 49124,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1065dec-63e2-5622-9daa-0a8c8b697b23/e1065dec-63e2-5622-9daa-0a8c8b697b23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5d420423f39a4ca59419a786ce30d367/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.3 TCe mild hybrid 160ch Techno EDC',
'transmission': 'automatic',
'trim': 'Captur 1.3 TCe mild hybrid 160ch Techno EDC',
'vin': None,
'year': 2023}
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980744%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [ayvens.fr] INFO: Saving data for 1980744: {'created_time': 1774370943.885721, 'last_price_update_time': 1774370943.885736, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980744') HTTP/1.1" 204 0
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/8.jpg not downloaded yet
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e9476cd0>
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/3.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e04390>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/5.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a80d0>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/4.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [ayvens.fr] INFO: Found listing with ID: 1980747
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980747%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [ayvens.fr] INFO: Scrape type for 1980747: 1
2026-03-24 16:49:04 [ayvens.fr] INFO: Extracting data for car ID: 1980747
2026-03-24 16:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 380fa326-1148-567b-8623-867ef8626bd5 with identifier: 1980747
2026-03-24 16:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380fa326-1148-567b-8623-867ef8626bd5 with scrape type 1
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/1.jpg not downloaded yet
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/2.jpg not downloaded yet
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/3.jpg not downloaded yet
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/4.jpg not downloaded yet
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07390>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/6.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c73b90>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/1.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0ac50>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/3.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c29d0>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/2.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5f50>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/7.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/5.jpg not downloaded yet
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/6.jpg not downloaded yet
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc0750>
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F97674054cd2f417a829d87e054c9dd34%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/8.jpg saved to cache
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20
2026-03-24 16:49:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20, skipping ID generation
2026-03-24 16:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 with scrape type 1
2026-03-24 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 sending to next pipeline
2026-03-24 16:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20, identifier: 1980745
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8b350>
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/4.jpg saved to cache
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666d350>
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/5.jpg saved to cache
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 with identifier: 1980745
2026-03-24 16:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 with identifier: 1980745
2026-03-24 16:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 39f8f977-a897-5ec8-ab3b-a5a1b94c8f20 with identifier: 1980745 to the API
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '39f8f977-a897-5ec8-ab3b-a5a1b94c8f20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA TS',
'odometer': 146125,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39f8f977-a897-5ec8-ab3b-a5a1b94c8f20/39f8f977-a897-5ec8-ab3b-a5a1b94c8f20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/97674054cd2f417a829d87e054c9dd34/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA TS Corolla Touring Spt 122h GR Sport',
'transmission': 'automatic',
'trim': 'Corolla Touring Spt 122h GR Sport',
'vin': None,
'year': 2023}
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980745%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [ayvens.fr] INFO: Saving data for 1980745: {'created_time': 1774370945.563563, 'last_price_update_time': 1774370945.563574, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980745') HTTP/1.1" 204 0
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/7.jpg not downloaded yet
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/8.jpg not downloaded yet
2026-03-24 16:49:05 [ayvens.fr] INFO: Found listing with ID: 1980748
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980748%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [ayvens.fr] INFO: Scrape type for 1980748: 1
2026-03-24 16:49:05 [ayvens.fr] INFO: Extracting data for car ID: 1980748
2026-03-24 16:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 362454e9-deac-5e28-9d5a-b6427dc5a744 with identifier: 1980748
2026-03-24 16:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362454e9-deac-5e28-9d5a-b6427dc5a744 with scrape type 1
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/1.jpg not downloaded yet
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/2.jpg not downloaded yet
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/3.jpg not downloaded yet
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31e90>
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/7.jpg saved to cache
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/4.jpg not downloaded yet
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/5.jpg not downloaded yet
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df85d0>
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/8.jpg saved to cache
2026-03-24 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5719a10>
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/2.jpg saved to cache
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf3210>
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/1.jpg saved to cache
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571ba50>
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F219bd70585cd446ab55d227f03db3829%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/6.jpg saved to cache
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 384569fb-707f-5d8f-922c-0bdd1ec950d0
2026-03-24 16:49:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 384569fb-707f-5d8f-922c-0bdd1ec950d0, skipping ID generation
2026-03-24 16:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384569fb-707f-5d8f-922c-0bdd1ec950d0 with scrape type 1
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 384569fb-707f-5d8f-922c-0bdd1ec950d0 sending to next pipeline
2026-03-24 16:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 384569fb-707f-5d8f-922c-0bdd1ec950d0, identifier: 1980746
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 384569fb-707f-5d8f-922c-0bdd1ec950d0 with identifier: 1980746
2026-03-24 16:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 384569fb-707f-5d8f-922c-0bdd1ec950d0 with identifier: 1980746
2026-03-24 16:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 384569fb-707f-5d8f-922c-0bdd1ec950d0 with identifier: 1980746 to the API
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 196,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '384569fb-707f-5d8f-922c-0bdd1ec950d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'PROACE',
'odometer': 175690,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_384569fb-707f-5d8f-922c-0bdd1ec950d0/384569fb-707f-5d8f-922c-0bdd1ec950d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/219bd70585cd446ab55d227f03db3829/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-25',
'seats_number': 3,
'seller_name': None,
'title': 'TOYOTA PROACE PROACE Medium 2.0 D-4D 140 Business BVA',
'transmission': 'automatic',
'trim': 'PROACE Medium 2.0 D-4D 140 Business BVA',
'vin': None,
'year': 2023}
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980746%27 HTTP/1.1" 200 None
2026-03-24 16:49:06 [ayvens.fr] INFO: Saving data for 1980746: {'created_time': 1774370946.672066, 'last_price_update_time': 1774370946.67208, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980746') HTTP/1.1" 204 0
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b1890>
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/3.jpg saved to cache
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570f890>
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/4.jpg saved to cache
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/6.jpg not downloaded yet
2026-03-24 16:49:06 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at -1 pages/min), scraped 138 items (at 36 items/min)
2026-03-24 16:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/7.jpg not downloaded yet
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b74d90>
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/5.jpg saved to cache
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/8.jpg not downloaded yet
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:06 [ayvens.fr] INFO: Found listing with ID: 1980749
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980749%27 HTTP/1.1" 200 None
2026-03-24 16:49:06 [ayvens.fr] INFO: Scrape type for 1980749: 1
2026-03-24 16:49:06 [ayvens.fr] INFO: Extracting data for car ID: 1980749
2026-03-24 16:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55b8bf0-9845-515a-98fd-5abcde062586 with identifier: 1980749
2026-03-24 16:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55b8bf0-9845-515a-98fd-5abcde062586 with scrape type 1
2026-03-24 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/1.jpg not downloaded yet
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cef010>
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/6.jpg saved to cache
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/2.jpg not downloaded yet
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75590>
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/1.jpg saved to cache
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/3.jpg not downloaded yet
2026-03-24 16:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6146f90>
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/3.jpg saved to cache
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5715ed0>
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/2.jpg saved to cache
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dc9c50>
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/8.jpg saved to cache
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9db50>
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F52bbd3e34c0140de84e8debae18facb0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/7.jpg saved to cache
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 380fa326-1148-567b-8623-867ef8626bd5
2026-03-24 16:49:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 380fa326-1148-567b-8623-867ef8626bd5, skipping ID generation
2026-03-24 16:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380fa326-1148-567b-8623-867ef8626bd5 with scrape type 1
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 380fa326-1148-567b-8623-867ef8626bd5 sending to next pipeline
2026-03-24 16:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 380fa326-1148-567b-8623-867ef8626bd5, identifier: 1980747
2026-03-24 16:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/4.jpg not downloaded yet
2026-03-24 16:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 380fa326-1148-567b-8623-867ef8626bd5 with identifier: 1980747
2026-03-24 16:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 380fa326-1148-567b-8623-867ef8626bd5 with identifier: 1980747
2026-03-24 16:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 380fa326-1148-567b-8623-867ef8626bd5 with identifier: 1980747 to the API
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 182,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '380fa326-1148-567b-8623-867ef8626bd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 47288,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_380fa326-1148-567b-8623-867ef8626bd5/380fa326-1148-567b-8623-867ef8626bd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/52bbd3e34c0140de84e8debae18facb0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-06',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM Transit Custom Fg 320 L1H1 2.0 EcoBlue 130 S&S '
'Trend Business BVA6',
'transmission': 'automatic',
'trim': 'Transit Custom Fg 320 L1H1 2.0 EcoBlue 130 S&S Trend Business BVA6',
'vin': None,
'year': 2019}
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980747%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [ayvens.fr] INFO: Saving data for 1980747: {'created_time': 1774370948.068127, 'last_price_update_time': 1774370948.068137, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980747') HTTP/1.1" 204 0
2026-03-24 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/5.jpg not downloaded yet
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4556c10>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/5.jpg saved to cache
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57274d0>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/6.jpg saved to cache
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5717a90>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/4.jpg saved to cache
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/6.jpg not downloaded yet
2026-03-24 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/7.jpg not downloaded yet
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c73b90>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/7.jpg saved to cache
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/8.jpg not downloaded yet
2026-03-24 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:08 [ayvens.fr] INFO: Found listing with ID: 1980750
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980750%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [ayvens.fr] INFO: Scrape type for 1980750: 1
2026-03-24 16:49:08 [ayvens.fr] INFO: Extracting data for car ID: 1980750
2026-03-24 16:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f495d5-121a-59a6-b2e0-78b0321e74b4 with identifier: 1980750
2026-03-24 16:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f495d5-121a-59a6-b2e0-78b0321e74b4 with scrape type 1
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/1.jpg not downloaded yet
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc2750>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/1.jpg saved to cache
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/2.jpg not downloaded yet
2026-03-24 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/3.jpg not downloaded yet
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfa450>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4c0f7dbe37214b70b72e10ae4ef0a683%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/8.jpg saved to cache
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 362454e9-deac-5e28-9d5a-b6427dc5a744
2026-03-24 16:49:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 362454e9-deac-5e28-9d5a-b6427dc5a744, skipping ID generation
2026-03-24 16:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362454e9-deac-5e28-9d5a-b6427dc5a744 with scrape type 1
2026-03-24 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 362454e9-deac-5e28-9d5a-b6427dc5a744 sending to next pipeline
2026-03-24 16:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 362454e9-deac-5e28-9d5a-b6427dc5a744, identifier: 1980748
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad650>
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/2.jpg saved to cache
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726c90>
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/3.jpg saved to cache
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/4.jpg not downloaded yet
2026-03-24 16:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 362454e9-deac-5e28-9d5a-b6427dc5a744 with identifier: 1980748
2026-03-24 16:49:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 362454e9-deac-5e28-9d5a-b6427dc5a744 with identifier: 1980748
2026-03-24 16:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 362454e9-deac-5e28-9d5a-b6427dc5a744 with identifier: 1980748 to the API
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'BLANC JADE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '362454e9-deac-5e28-9d5a-b6427dc5a744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 133066,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362454e9-deac-5e28-9d5a-b6427dc5a744/362454e9-deac-5e28-9d5a-b6427dc5a744_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4c0f7dbe37214b70b72e10ae4ef0a683/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.5 D 120ch Elegance Business BVA',
'transmission': 'automatic',
'trim': 'Crossland 1.5 D 120ch Elegance Business BVA',
'vin': None,
'year': 2022}
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980748%27 HTTP/1.1" 200 None
2026-03-24 16:49:09 [ayvens.fr] INFO: Saving data for 1980748: {'created_time': 1774370949.660547, 'last_price_update_time': 1774370949.660557, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980748') HTTP/1.1" 204 0
2026-03-24 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/5.jpg not downloaded yet
2026-03-24 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5715210>
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/5.jpg saved to cache
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/6.jpg not downloaded yet
2026-03-24 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/7.jpg not downloaded yet
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56dab10>
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/4.jpg saved to cache
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bba750>
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/6.jpg saved to cache
2026-03-24 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/8.jpg not downloaded yet
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a05110>
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/7.jpg saved to cache
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:10 [ayvens.fr] INFO: Found listing with ID: 1980751
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980751%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [ayvens.fr] INFO: Scrape type for 1980751: 1
2026-03-24 16:49:10 [ayvens.fr] INFO: Extracting data for car ID: 1980751
2026-03-24 16:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab47906c-356e-52f3-8b70-459fd56203c1 with identifier: 1980751
2026-03-24 16:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab47906c-356e-52f3-8b70-459fd56203c1 with scrape type 1
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/1.jpg not downloaded yet
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d571d0>
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe6ca3a038a3a48c789081b18bbd51ba0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/8.jpg saved to cache
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e55b8bf0-9845-515a-98fd-5abcde062586
2026-03-24 16:49:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e55b8bf0-9845-515a-98fd-5abcde062586, skipping ID generation
2026-03-24 16:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55b8bf0-9845-515a-98fd-5abcde062586 with scrape type 1
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e55b8bf0-9845-515a-98fd-5abcde062586 sending to next pipeline
2026-03-24 16:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e55b8bf0-9845-515a-98fd-5abcde062586, identifier: 1980749
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/2.jpg not downloaded yet
2026-03-24 16:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e55b8bf0-9845-515a-98fd-5abcde062586 with identifier: 1980749
2026-03-24 16:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e55b8bf0-9845-515a-98fd-5abcde062586 with identifier: 1980749
2026-03-24 16:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e55b8bf0-9845-515a-98fd-5abcde062586 with identifier: 1980749 to the API
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'e55b8bf0-9845-515a-98fd-5abcde062586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55b8bf0-9845-515a-98fd-5abcde062586/e55b8bf0-9845-515a-98fd-5abcde062586_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e6ca3a038a3a48c789081b18bbd51ba0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-17',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Ste 1.0 TCe 90ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Ste 1.0 TCe 90ch Air Nav',
'vin': None,
'year': 2021}
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980749%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [ayvens.fr] INFO: Saving data for 1980749: {'created_time': 1774370950.612632, 'last_price_update_time': 1774370950.612643, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980749') HTTP/1.1" 204 0
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aa310>
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/1.jpg saved to cache
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/3.jpg not downloaded yet
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc7910>
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/2.jpg saved to cache
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/4.jpg not downloaded yet
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/5.jpg not downloaded yet
2026-03-24 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5390>
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/3.jpg saved to cache
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c60a50>
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/4.jpg saved to cache
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f0750>
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/5.jpg saved to cache
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/6.jpg not downloaded yet
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/7.jpg not downloaded yet
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6101210>
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/6.jpg saved to cache
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a96d0>
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/7.jpg saved to cache
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c826d0>
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4060998e7b6d47fbbd7ca3c1d33b545f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/8.jpg saved to cache
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76f495d5-121a-59a6-b2e0-78b0321e74b4
2026-03-24 16:49:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76f495d5-121a-59a6-b2e0-78b0321e74b4, skipping ID generation
2026-03-24 16:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f495d5-121a-59a6-b2e0-78b0321e74b4 with scrape type 1
2026-03-24 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76f495d5-121a-59a6-b2e0-78b0321e74b4 sending to next pipeline
2026-03-24 16:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 76f495d5-121a-59a6-b2e0-78b0321e74b4, identifier: 1980750
2026-03-24 16:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 76f495d5-121a-59a6-b2e0-78b0321e74b4 with identifier: 1980750
2026-03-24 16:49:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 76f495d5-121a-59a6-b2e0-78b0321e74b4 with identifier: 1980750
2026-03-24 16:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 76f495d5-121a-59a6-b2e0-78b0321e74b4 with identifier: 1980750 to the API
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '76f495d5-121a-59a6-b2e0-78b0321e74b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 79241,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f495d5-121a-59a6-b2e0-78b0321e74b4/76f495d5-121a-59a6-b2e0-78b0321e74b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4060998e7b6d47fbbd7ca3c1d33b545f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-20',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT SCENIC Grand Scenic 1.3 TCe 140ch Techno EDC 7 places',
'transmission': 'automatic',
'trim': 'Grand Scenic 1.3 TCe 140ch Techno EDC 7 places',
'vin': None,
'year': 2023}
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980750%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [ayvens.fr] INFO: Saving data for 1980750: {'created_time': 1774370952.043726, 'last_price_update_time': 1774370952.043737, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980750') HTTP/1.1" 204 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/8.jpg not downloaded yet
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [ayvens.fr] INFO: Found listing with ID: 1980752
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980752%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [ayvens.fr] INFO: Scrape type for 1980752: 1
2026-03-24 16:49:12 [ayvens.fr] INFO: Extracting data for car ID: 1980752
2026-03-24 16:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c34f786-4cad-5746-aa47-6ddedbef1d9f with identifier: 1980752
2026-03-24 16:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f with scrape type 1
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/1.jpg not downloaded yet
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/2.jpg not downloaded yet
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/3.jpg not downloaded yet
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/4.jpg not downloaded yet
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/5.jpg not downloaded yet
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d02210>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/1.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/6.jpg not downloaded yet
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/7.jpg not downloaded yet
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4110>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/3.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d29850>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/2.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f490>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/5.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/8.jpg not downloaded yet
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61012d0>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/4.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [ayvens.fr] INFO: Found listing with ID: 1980753
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980753%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [ayvens.fr] INFO: Scrape type for 1980753: 1
2026-03-24 16:49:12 [ayvens.fr] INFO: Extracting data for car ID: 1980753
2026-03-24 16:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 with identifier: 1980753
2026-03-24 16:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 with scrape type 1
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/1.jpg not downloaded yet
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da5250>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/7.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/2.jpg not downloaded yet
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/3.jpg not downloaded yet
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621e550>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/6.jpg saved to cache
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/4.jpg not downloaded yet
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/5.jpg not downloaded yet
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb9190>
2026-03-24 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/1.jpg saved to cache
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cafa50>
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/3.jpg saved to cache
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b1110>
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F78e8f7dad53a454db068711cca7ca739%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/8.jpg saved to cache
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab47906c-356e-52f3-8b70-459fd56203c1
2026-03-24 16:49:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab47906c-356e-52f3-8b70-459fd56203c1, skipping ID generation
2026-03-24 16:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab47906c-356e-52f3-8b70-459fd56203c1 with scrape type 1
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab47906c-356e-52f3-8b70-459fd56203c1 sending to next pipeline
2026-03-24 16:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ab47906c-356e-52f3-8b70-459fd56203c1, identifier: 1980751
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ed50>
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/2.jpg saved to cache
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2a210>
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/5.jpg saved to cache
2026-03-24 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ab47906c-356e-52f3-8b70-459fd56203c1 with identifier: 1980751
2026-03-24 16:49:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ab47906c-356e-52f3-8b70-459fd56203c1 with identifier: 1980751
2026-03-24 16:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ab47906c-356e-52f3-8b70-459fd56203c1 with identifier: 1980751 to the API
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'ab47906c-356e-52f3-8b70-459fd56203c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 132262,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab47906c-356e-52f3-8b70-459fd56203c1/ab47906c-356e-52f3-8b70-459fd56203c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/78e8f7dad53a454db068711cca7ca739/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.5 Blue dCi 115ch Evolution',
'transmission': 'manual',
'trim': 'Megane 1.5 Blue dCi 115ch Evolution',
'vin': None,
'year': 2023}
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980751%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [ayvens.fr] INFO: Saving data for 1980751: {'created_time': 1774370954.024428, 'last_price_update_time': 1774370954.02444, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980751') HTTP/1.1" 204 0
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c54f50>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/4.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/6.jpg not downloaded yet
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/7.jpg not downloaded yet
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/8.jpg not downloaded yet
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [ayvens.fr] INFO: Found listing with ID: 1980754
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980754%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [ayvens.fr] INFO: Scrape type for 1980754: 1
2026-03-24 16:49:14 [ayvens.fr] INFO: Extracting data for car ID: 1980754
2026-03-24 16:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3c3839-0fbe-56f9-a478-f3c75a3dd403 with identifier: 1980754
2026-03-24 16:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403 with scrape type 1
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/1.jpg not downloaded yet
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/2.jpg not downloaded yet
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56caa90>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/7.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/3.jpg not downloaded yet
2026-03-24 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcd9d0>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/6.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/4.jpg not downloaded yet
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83490>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F2f605dedcc92453b83015a4ffe1d9c67%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/8.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f
2026-03-24 16:49:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c34f786-4cad-5746-aa47-6ddedbef1d9f, skipping ID generation
2026-03-24 16:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f with scrape type 1
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c34f786-4cad-5746-aa47-6ddedbef1d9f sending to next pipeline
2026-03-24 16:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3c34f786-4cad-5746-aa47-6ddedbef1d9f, identifier: 1980752
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b85c90>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/1.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605ad90>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/3.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454f610>
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/2.jpg saved to cache
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/5.jpg not downloaded yet
2026-03-24 16:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3c34f786-4cad-5746-aa47-6ddedbef1d9f with identifier: 1980752
2026-03-24 16:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3c34f786-4cad-5746-aa47-6ddedbef1d9f with identifier: 1980752
2026-03-24 16:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3c34f786-4cad-5746-aa47-6ddedbef1d9f with identifier: 1980752 to the API
2026-03-24 16:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '3c34f786-4cad-5746-aa47-6ddedbef1d9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 58945,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34f786-4cad-5746-aa47-6ddedbef1d9f/3c34f786-4cad-5746-aa47-6ddedbef1d9f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/2f605dedcc92453b83015a4ffe1d9c67/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 1.0 TSI OPF 110ch Life Business 1st',
'transmission': 'manual',
'trim': 'Golf 1.0 TSI OPF 110ch Life Business 1st',
'vin': None,
'year': 2021}
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980752%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [ayvens.fr] INFO: Saving data for 1980752: {'created_time': 1774370955.37247, 'last_price_update_time': 1774370955.372481, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980752') HTTP/1.1" 204 0
2026-03-24 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f41dbb90>
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/4.jpg saved to cache
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/6.jpg not downloaded yet
2026-03-24 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/7.jpg not downloaded yet
2026-03-24 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/8.jpg not downloaded yet
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570e9d0>
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/5.jpg saved to cache
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2a590>
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/7.jpg saved to cache
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:15 [ayvens.fr] INFO: Found listing with ID: 1980755
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980755%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [ayvens.fr] INFO: Scrape type for 1980755: 1
2026-03-24 16:49:15 [ayvens.fr] INFO: Extracting data for car ID: 1980755
2026-03-24 16:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4194f172-f682-518d-8221-3b439e54da47 with identifier: 1980755
2026-03-24 16:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4194f172-f682-518d-8221-3b439e54da47 with scrape type 1
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/1.jpg not downloaded yet
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/2.jpg not downloaded yet
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfaad0>
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/6.jpg saved to cache
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cac510>
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9c851633f869440b9a8812e40e7c8ea8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/8.jpg saved to cache
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67
2026-03-24 16:49:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8385ad8e-0d41-5bf1-bda9-0bf55905ec67, skipping ID generation
2026-03-24 16:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 with scrape type 1
2026-03-24 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 sending to next pipeline
2026-03-24 16:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8385ad8e-0d41-5bf1-bda9-0bf55905ec67, identifier: 1980753
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570fb90>
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/1.jpg saved to cache
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e610>
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/2.jpg saved to cache
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 with identifier: 1980753
2026-03-24 16:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 with identifier: 1980753
2026-03-24 16:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8385ad8e-0d41-5bf1-bda9-0bf55905ec67 with identifier: 1980753 to the API
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '8385ad8e-0d41-5bf1-bda9-0bf55905ec67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 42247,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8385ad8e-0d41-5bf1-bda9-0bf55905ec67/8385ad8e-0d41-5bf1-bda9-0bf55905ec67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9c851633f869440b9a8812e40e7c8ea8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-14',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT PARTNER Partner Standard 650kg Puretech 110ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Partner Standard 650kg Puretech 110ch S&S Asphalt',
'vin': None,
'year': 2020}
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980753%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [ayvens.fr] INFO: Saving data for 1980753: {'created_time': 1774370956.582969, 'last_price_update_time': 1774370956.58298, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980753') HTTP/1.1" 204 0
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/3.jpg not downloaded yet
2026-03-24 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/4.jpg not downloaded yet
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/5.jpg not downloaded yet
2026-03-24 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/6.jpg not downloaded yet
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/7.jpg not downloaded yet
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/8.jpg not downloaded yet
2026-03-24 16:49:16 [ayvens.fr] INFO: Found listing with ID: 1980756
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980756%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [ayvens.fr] INFO: Scrape type for 1980756: 1
2026-03-24 16:49:16 [ayvens.fr] INFO: Extracting data for car ID: 1980756
2026-03-24 16:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba with identifier: 1980756
2026-03-24 16:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba with scrape type 1
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/1.jpg not downloaded yet
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/2.jpg not downloaded yet
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0e90>
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/4.jpg saved to cache
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce9310>
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/3.jpg saved to cache
2026-03-24 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103890>
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/6.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8850>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/5.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5727e10>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/7.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/3.jpg not downloaded yet
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf2d90>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3bc665f3841a410ea9dfb623eb0562b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/8.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403
2026-03-24 16:49:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea3c3839-0fbe-56f9-a478-f3c75a3dd403, skipping ID generation
2026-03-24 16:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403 with scrape type 1
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea3c3839-0fbe-56f9-a478-f3c75a3dd403 sending to next pipeline
2026-03-24 16:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ea3c3839-0fbe-56f9-a478-f3c75a3dd403, identifier: 1980754
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/4.jpg not downloaded yet
2026-03-24 16:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ea3c3839-0fbe-56f9-a478-f3c75a3dd403 with identifier: 1980754
2026-03-24 16:49:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ea3c3839-0fbe-56f9-a478-f3c75a3dd403 with identifier: 1980754
2026-03-24 16:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ea3c3839-0fbe-56f9-a478-f3c75a3dd403 with identifier: 1980754 to the API
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'GRIS PLATINIUM M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'ea3c3839-0fbe-56f9-a478-f3c75a3dd403',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 SPACETOURER',
'odometer': 101460,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366314,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3c3839-0fbe-56f9-a478-f3c75a3dd403/ea3c3839-0fbe-56f9-a478-f3c75a3dd403_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3bc665f3841a410ea9dfb623eb0562b3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seats_number': 7,
'seller_name': None,
'title': 'CITROËN C4 SPACETOURER Grand C4 SpaceTourer BlueHDi 130ch S&S '
'Business EAT8',
'transmission': 'automatic',
'trim': 'Grand C4 SpaceTourer BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980754%27 HTTP/1.1" 200 None
2026-03-24 16:49:17 [ayvens.fr] INFO: Saving data for 1980754: {'created_time': 1774370957.722578, 'last_price_update_time': 1774370957.72259, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980754') HTTP/1.1" 204 0
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/5.jpg not downloaded yet
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6040e50>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/2.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb9790>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/5.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/6.jpg not downloaded yet
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d32150>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/6.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45547d0>
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/3.jpg saved to cache
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/7.jpg not downloaded yet
2026-03-24 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/8.jpg not downloaded yet
2026-03-24 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c2c90>
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/1.jpg saved to cache
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aab10>
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/7.jpg saved to cache
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d73250>
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/4.jpg saved to cache
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605bed0>
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F85d8f6f38deb4bb6b1040f86d840c748%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/8.jpg saved to cache
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4194f172-f682-518d-8221-3b439e54da47
2026-03-24 16:49:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4194f172-f682-518d-8221-3b439e54da47, skipping ID generation
2026-03-24 16:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4194f172-f682-518d-8221-3b439e54da47 with scrape type 1
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4194f172-f682-518d-8221-3b439e54da47 sending to next pipeline
2026-03-24 16:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4194f172-f682-518d-8221-3b439e54da47, identifier: 1980755
2026-03-24 16:49:18 [ayvens.fr] INFO: Found listing with ID: 1980757
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980757%27 HTTP/1.1" 200 None
2026-03-24 16:49:18 [ayvens.fr] INFO: Scrape type for 1980757: 1
2026-03-24 16:49:18 [ayvens.fr] INFO: Extracting data for car ID: 1980757
2026-03-24 16:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b044931d-c75b-5cfd-bb53-6133a31ef476 with identifier: 1980757
2026-03-24 16:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b044931d-c75b-5cfd-bb53-6133a31ef476 with scrape type 1
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/1.jpg not downloaded yet
2026-03-24 16:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4194f172-f682-518d-8221-3b439e54da47 with identifier: 1980755
2026-03-24 16:49:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4194f172-f682-518d-8221-3b439e54da47 with identifier: 1980755
2026-03-24 16:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4194f172-f682-518d-8221-3b439e54da47 with identifier: 1980755 to the API
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'BLANC ARCTIQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '4194f172-f682-518d-8221-3b439e54da47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'VITO',
'odometer': 51746,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4194f172-f682-518d-8221-3b439e54da47/4194f172-f682-518d-8221-3b439e54da47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/85d8f6f38deb4bb6b1040f86d840c748/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'seats_number': 3,
'seller_name': None,
'title': 'MERCEDES-BENZ VITO Vito Fg 116 CDI Compact Pro Propulsion 9G-Tronic',
'transmission': 'automatic',
'trim': 'Vito Fg 116 CDI Compact Pro Propulsion 9G-Tronic',
'vin': None,
'year': 2022}
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980755%27 HTTP/1.1" 200 None
2026-03-24 16:49:18 [ayvens.fr] INFO: Saving data for 1980755: {'created_time': 1774370958.852654, 'last_price_update_time': 1774370958.852665, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980755') HTTP/1.1" 204 0
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/2.jpg not downloaded yet
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d5e10>
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/1.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c698d0>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/2.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/3.jpg not downloaded yet
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/4.jpg not downloaded yet
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/5.jpg not downloaded yet
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/6.jpg not downloaded yet
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/7.jpg not downloaded yet
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/8.jpg not downloaded yet
2026-03-24 16:49:19 [ayvens.fr] INFO: Found listing with ID: 1980758
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980758%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [ayvens.fr] INFO: Scrape type for 1980758: 1
2026-03-24 16:49:19 [ayvens.fr] INFO: Extracting data for car ID: 1980758
2026-03-24 16:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96616bd5-8a0e-51c9-8e62-994ca64eca48 with identifier: 1980758
2026-03-24 16:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96616bd5-8a0e-51c9-8e62-994ca64eca48 with scrape type 1
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/1.jpg not downloaded yet
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570ded0>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/4.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726710>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/3.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/2.jpg not downloaded yet
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d7650>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/6.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbb890>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/5.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da5fd0>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/8.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/3.jpg not downloaded yet
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/4.jpg not downloaded yet
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbb250>
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fecc8cbad738d4ea9bf9f018187ac9314%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/7.jpg saved to cache
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba
2026-03-24 16:49:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba, skipping ID generation
2026-03-24 16:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba with scrape type 1
2026-03-24 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba sending to next pipeline
2026-03-24 16:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba, identifier: 1980756
2026-03-24 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba with identifier: 1980756
2026-03-24 16:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba with identifier: 1980756
2026-03-24 16:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba with identifier: 1980756 to the API
2026-03-24 16:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 28,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'd273dd3b-82eb-5e8b-a57b-0a1cddc2bdba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 69418,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba/d273dd3b-82eb-5e8b-a57b-0a1cddc2bdba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/ecc8cbad738d4ea9bf9f018187ac9314/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-05',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.6 E-Tech Plug-in 160ch Intens -21N',
'transmission': 'automatic',
'trim': 'Megane Estate 1.6 E-Tech Plug-in 160ch Intens -21N',
'vin': None,
'year': 2022}
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980756%27 HTTP/1.1" 200 None
2026-03-24 16:49:20 [ayvens.fr] INFO: Saving data for 1980756: {'created_time': 1774370960.365118, 'last_price_update_time': 1774370960.36513, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980756') HTTP/1.1" 204 0
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/5.jpg not downloaded yet
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/6.jpg not downloaded yet
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4d850>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/7.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5e650>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/1.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/7.jpg not downloaded yet
2026-03-24 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/8.jpg not downloaded yet
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1fd10>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/5.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0be90>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/6.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5a650>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/8.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050710>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/4.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0bc10>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/2.jpg saved to cache
2026-03-24 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d61490>
2026-03-24 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F02180f2cfd29457aad9e740b6c8bc1c0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/3.jpg saved to cache
2026-03-24 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b044931d-c75b-5cfd-bb53-6133a31ef476
2026-03-24 16:49:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b044931d-c75b-5cfd-bb53-6133a31ef476, skipping ID generation
2026-03-24 16:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b044931d-c75b-5cfd-bb53-6133a31ef476 with scrape type 1
2026-03-24 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b044931d-c75b-5cfd-bb53-6133a31ef476 sending to next pipeline
2026-03-24 16:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b044931d-c75b-5cfd-bb53-6133a31ef476, identifier: 1980757
2026-03-24 16:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b044931d-c75b-5cfd-bb53-6133a31ef476 with identifier: 1980757
2026-03-24 16:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b044931d-c75b-5cfd-bb53-6133a31ef476 with identifier: 1980757
2026-03-24 16:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b044931d-c75b-5cfd-bb53-6133a31ef476 with identifier: 1980757 to the API
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b044931d-c75b-5cfd-bb53-6133a31ef476',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 28538,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b044931d-c75b-5cfd-bb53-6133a31ef476/b044931d-c75b-5cfd-bb53-6133a31ef476_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/02180f2cfd29457aad9e740b6c8bc1c0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-23',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Dolcevita',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Dolcevita',
'vin': None,
'year': 2022}
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980757%27 HTTP/1.1" 200 None
2026-03-24 16:49:21 [ayvens.fr] INFO: Saving data for 1980757: {'created_time': 1774370961.994518, 'last_price_update_time': 1774370961.994533, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980757') HTTP/1.1" 204 0
2026-03-24 16:49:22 [ayvens.fr] INFO: Found listing with ID: 1980759
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980759%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [ayvens.fr] INFO: Scrape type for 1980759: 1
2026-03-24 16:49:22 [ayvens.fr] INFO: Extracting data for car ID: 1980759
2026-03-24 16:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4905e194-2a0b-5c30-8988-11b5b045fca9 with identifier: 1980759
2026-03-24 16:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4905e194-2a0b-5c30-8988-11b5b045fca9 with scrape type 1
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/1.jpg not downloaded yet
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60b50>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/1.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/2.jpg not downloaded yet
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/3.jpg not downloaded yet
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/4.jpg not downloaded yet
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/5.jpg not downloaded yet
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/6.jpg not downloaded yet
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c80dd0>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/2.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b86f10>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/3.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/7.jpg not downloaded yet
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a0c590>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/4.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f5810>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/6.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/8.jpg not downloaded yet
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457ce10>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/5.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56daa50>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/7.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [ayvens.fr] INFO: Found listing with ID: 1980760
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980760%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [ayvens.fr] INFO: Scrape type for 1980760: 1
2026-03-24 16:49:22 [ayvens.fr] INFO: Extracting data for car ID: 1980760
2026-03-24 16:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c8a50c2-43c7-5bf7-9182-49b2729ca36f with identifier: 1980760
2026-03-24 16:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f with scrape type 1
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/1.jpg not downloaded yet
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d190>
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F594d6d54cbfd40a6992f54cf8bcc24cb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/8.jpg saved to cache
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96616bd5-8a0e-51c9-8e62-994ca64eca48
2026-03-24 16:49:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96616bd5-8a0e-51c9-8e62-994ca64eca48, skipping ID generation
2026-03-24 16:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96616bd5-8a0e-51c9-8e62-994ca64eca48 with scrape type 1
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96616bd5-8a0e-51c9-8e62-994ca64eca48 sending to next pipeline
2026-03-24 16:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 96616bd5-8a0e-51c9-8e62-994ca64eca48, identifier: 1980758
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/2.jpg not downloaded yet
2026-03-24 16:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 96616bd5-8a0e-51c9-8e62-994ca64eca48 with identifier: 1980758
2026-03-24 16:49:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 96616bd5-8a0e-51c9-8e62-994ca64eca48 with identifier: 1980758
2026-03-24 16:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 96616bd5-8a0e-51c9-8e62-994ca64eca48 with identifier: 1980758 to the API
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'ARGENT FLEURET',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '96616bd5-8a0e-51c9-8e62-994ca64eca48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A5 SPORTBACK',
'odometer': 119229,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341598,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341598,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96616bd5-8a0e-51c9-8e62-994ca64eca48/96616bd5-8a0e-51c9-8e62-994ca64eca48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/594d6d54cbfd40a6992f54cf8bcc24cb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A5 SPORTBACK A5 Sportback 40 TFSI 204ch Business line S tronic '
'7',
'transmission': 'automatic',
'trim': 'A5 Sportback 40 TFSI 204ch Business line S tronic 7',
'vin': None,
'year': 2022}
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980758%27 HTTP/1.1" 200 None
2026-03-24 16:49:23 [ayvens.fr] INFO: Saving data for 1980758: {'created_time': 1774370963.493252, 'last_price_update_time': 1774370963.493263, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980758') HTTP/1.1" 204 0
2026-03-24 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/3.jpg not downloaded yet
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621c3d0>
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/2.jpg saved to cache
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7db50>
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/1.jpg saved to cache
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df8a90>
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/3.jpg saved to cache
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/4.jpg not downloaded yet
2026-03-24 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/5.jpg not downloaded yet
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7d750>
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/4.jpg saved to cache
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d01690>
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/5.jpg saved to cache
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/6.jpg not downloaded yet
2026-03-24 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/7.jpg not downloaded yet
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454f050>
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/7.jpg saved to cache
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b874d0>
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/6.jpg saved to cache
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/8.jpg not downloaded yet
2026-03-24 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e819fd10>
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2f6fac261bd440df8bfe2b8e1fc5ad58%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/8.jpg saved to cache
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4905e194-2a0b-5c30-8988-11b5b045fca9
2026-03-24 16:49:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4905e194-2a0b-5c30-8988-11b5b045fca9, skipping ID generation
2026-03-24 16:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4905e194-2a0b-5c30-8988-11b5b045fca9 with scrape type 1
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4905e194-2a0b-5c30-8988-11b5b045fca9 sending to next pipeline
2026-03-24 16:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4905e194-2a0b-5c30-8988-11b5b045fca9, identifier: 1980759
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08290>
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/1.jpg saved to cache
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:24 [ayvens.fr] INFO: Found listing with ID: 1980761
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980761%27 HTTP/1.1" 200 None
2026-03-24 16:49:24 [ayvens.fr] INFO: Scrape type for 1980761: 1
2026-03-24 16:49:24 [ayvens.fr] INFO: Extracting data for car ID: 1980761
2026-03-24 16:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed2a22a-1513-5366-9abb-9c8e15842542 with identifier: 1980761
2026-03-24 16:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed2a22a-1513-5366-9abb-9c8e15842542 with scrape type 1
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/1.jpg not downloaded yet
2026-03-24 16:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4905e194-2a0b-5c30-8988-11b5b045fca9 with identifier: 1980759
2026-03-24 16:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4905e194-2a0b-5c30-8988-11b5b045fca9 with identifier: 1980759
2026-03-24 16:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4905e194-2a0b-5c30-8988-11b5b045fca9 with identifier: 1980759 to the API
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '4905e194-2a0b-5c30-8988-11b5b045fca9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 62072,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4905e194-2a0b-5c30-8988-11b5b045fca9/4905e194-2a0b-5c30-8988-11b5b045fca9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2f6fac261bd440df8bfe2b8e1fc5ad58/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-11',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM Transit Custom Fg 300 L1H1 2.0 EcoBlue 130 '
'Trend Business',
'transmission': 'manual',
'trim': 'Transit Custom Fg 300 L1H1 2.0 EcoBlue 130 Trend Business',
'vin': None,
'year': 2022}
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980759%27 HTTP/1.1" 200 None
2026-03-24 16:49:24 [ayvens.fr] INFO: Saving data for 1980759: {'created_time': 1774370964.742659, 'last_price_update_time': 1774370964.74267, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980759') HTTP/1.1" 204 0
2026-03-24 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/2.jpg not downloaded yet
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454e310>
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/3.jpg saved to cache
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07390>
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/2.jpg saved to cache
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/3.jpg not downloaded yet
2026-03-24 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/4.jpg not downloaded yet
2026-03-24 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccff50>
2026-03-24 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/5.jpg saved to cache
2026-03-24 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/5.jpg not downloaded yet
2026-03-24 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e06590>
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/4.jpg saved to cache
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5a8d0>
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/6.jpg saved to cache
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/6.jpg not downloaded yet
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/7.jpg not downloaded yet
2026-03-24 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da7e50>
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/8.jpg saved to cache
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/8.jpg not downloaded yet
2026-03-24 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:27 [ayvens.fr] INFO: Found listing with ID: 1980762
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980762%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [ayvens.fr] INFO: Scrape type for 1980762: 1
2026-03-24 16:49:27 [ayvens.fr] INFO: Extracting data for car ID: 1980762
2026-03-24 16:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b22628e1-0ca5-5ffe-aecf-f7ced62ed333 with identifier: 1980762
2026-03-24 16:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333 with scrape type 1
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/1.jpg not downloaded yet
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/2.jpg not downloaded yet
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3050>
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F20283e46f2e44f94ab1e8ed14faa8d56%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/7.jpg saved to cache
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f
2026-03-24 16:49:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c8a50c2-43c7-5bf7-9182-49b2729ca36f, skipping ID generation
2026-03-24 16:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f with scrape type 1
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c8a50c2-43c7-5bf7-9182-49b2729ca36f sending to next pipeline
2026-03-24 16:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7c8a50c2-43c7-5bf7-9182-49b2729ca36f, identifier: 1980760
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457f450>
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/1.jpg saved to cache
2026-03-24 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccdf50>
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/2.jpg saved to cache
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/3.jpg not downloaded yet
2026-03-24 16:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7c8a50c2-43c7-5bf7-9182-49b2729ca36f with identifier: 1980760
2026-03-24 16:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7c8a50c2-43c7-5bf7-9182-49b2729ca36f with identifier: 1980760
2026-03-24 16:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7c8a50c2-43c7-5bf7-9182-49b2729ca36f with identifier: 1980760 to the API
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '7c8a50c2-43c7-5bf7-9182-49b2729ca36f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 9309,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328345,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8a50c2-43c7-5bf7-9182-49b2729ca36f/7c8a50c2-43c7-5bf7-9182-49b2729ca36f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/20283e46f2e44f94ab1e8ed14faa8d56/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-04',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express ZE Extra R-Link Achat '
'Intégral',
'transmission': 'automatic',
'trim': 'Kangoo Express ZE Extra R-Link Achat Intégral',
'vin': None,
'year': 2020}
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980760%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [ayvens.fr] INFO: Saving data for 1980760: {'created_time': 1774370968.462174, 'last_price_update_time': 1774370968.462185, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980760') HTTP/1.1" 204 0
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/4.jpg not downloaded yet
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9510>
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/3.jpg saved to cache
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/5.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/6.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/7.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/8.jpg not downloaded yet
2026-03-24 16:49:28 [ayvens.fr] INFO: Found listing with ID: 1980763
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980763%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [ayvens.fr] INFO: Scrape type for 1980763: 1
2026-03-24 16:49:28 [ayvens.fr] INFO: Extracting data for car ID: 1980763
2026-03-24 16:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c15ee1db-872a-5f7a-b3a0-e05536c9097f with identifier: 1980763
2026-03-24 16:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15ee1db-872a-5f7a-b3a0-e05536c9097f with scrape type 1
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/1.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/2.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/3.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/4.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/5.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/6.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/7.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/8.jpg not downloaded yet
2026-03-24 16:49:28 [ayvens.fr] INFO: Found listing with ID: 1980764
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980764%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [ayvens.fr] INFO: Scrape type for 1980764: 1
2026-03-24 16:49:28 [ayvens.fr] INFO: Extracting data for car ID: 1980764
2026-03-24 16:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9fcbb1-1c07-5968-8fea-b7672c8647d0 with identifier: 1980764
2026-03-24 16:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0 with scrape type 1
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/1.jpg not downloaded yet
2026-03-24 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/2.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/3.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/4.jpg not downloaded yet
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/5.jpg not downloaded yet
2026-03-24 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/6.jpg not downloaded yet
2026-03-24 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/7.jpg not downloaded yet
2026-03-24 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/8.jpg not downloaded yet
2026-03-24 16:49:28 [ayvens.fr] INFO: Found listing with ID: 1980765
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980765%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [ayvens.fr] INFO: Scrape type for 1980765: 1
2026-03-24 16:49:28 [ayvens.fr] INFO: Extracting data for car ID: 1980765
2026-03-24 16:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73b5a705-974f-59eb-b919-6588ec9bd924 with identifier: 1980765
2026-03-24 16:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b5a705-974f-59eb-b919-6588ec9bd924 with scrape type 1
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/1.jpg not downloaded yet
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83250>
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/5.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61985d0>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/6.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/2.jpg not downloaded yet
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/3.jpg not downloaded yet
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd76d0>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/7.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f41dbb90>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/1.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb6950>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/5.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce2b90>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/8.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/4.jpg not downloaded yet
2026-03-24 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/5.jpg not downloaded yet
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/6.jpg not downloaded yet
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4f7d0>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/4.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454fb50>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fb6fcfd86ce1240a789b0ab272661ed65%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/4.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ed2a22a-1513-5366-9abb-9c8e15842542
2026-03-24 16:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ed2a22a-1513-5366-9abb-9c8e15842542, skipping ID generation
2026-03-24 16:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed2a22a-1513-5366-9abb-9c8e15842542 with scrape type 1
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ed2a22a-1513-5366-9abb-9c8e15842542 sending to next pipeline
2026-03-24 16:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1ed2a22a-1513-5366-9abb-9c8e15842542, identifier: 1980761
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a9190>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/6.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8207250>
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/8.jpg saved to cache
2026-03-24 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1ed2a22a-1513-5366-9abb-9c8e15842542 with identifier: 1980761
2026-03-24 16:49:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1ed2a22a-1513-5366-9abb-9c8e15842542 with identifier: 1980761
2026-03-24 16:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1ed2a22a-1513-5366-9abb-9c8e15842542 with identifier: 1980761 to the API
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'GRIS LUNAIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '1ed2a22a-1513-5366-9abb-9c8e15842542',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FIESTA',
'odometer': 70816,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ed2a22a-1513-5366-9abb-9c8e15842542/1ed2a22a-1513-5366-9abb-9c8e15842542_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/b6fcfd86ce1240a789b0ab272661ed65/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FIESTA Fiesta 1.0 EcoBoost 95ch Connect Business 5p',
'transmission': 'manual',
'trim': 'Fiesta 1.0 EcoBoost 95ch Connect Business 5p',
'vin': None,
'year': 2020}
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980761%27 HTTP/1.1" 200 None
2026-03-24 16:49:30 [ayvens.fr] INFO: Saving data for 1980761: {'created_time': 1774370970.444044, 'last_price_update_time': 1774370970.444058, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980761') HTTP/1.1" 204 0
2026-03-24 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/7.jpg not downloaded yet
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/8.jpg not downloaded yet
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570e290>
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/2.jpg saved to cache
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2a010>
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/7.jpg saved to cache
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0ff50>
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Faa86357524024bb89125b26374cea14f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/3.jpg saved to cache
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333
2026-03-24 16:49:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b22628e1-0ca5-5ffe-aecf-f7ced62ed333, skipping ID generation
2026-03-24 16:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333 with scrape type 1
2026-03-24 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b22628e1-0ca5-5ffe-aecf-f7ced62ed333 sending to next pipeline
2026-03-24 16:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b22628e1-0ca5-5ffe-aecf-f7ced62ed333, identifier: 1980762
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6125a10>
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/1.jpg saved to cache
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [ayvens.fr] INFO: Found listing with ID: 1980766
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980766%27 HTTP/1.1" 200 None
2026-03-24 16:49:31 [ayvens.fr] INFO: Scrape type for 1980766: 1
2026-03-24 16:49:31 [ayvens.fr] INFO: Extracting data for car ID: 1980766
2026-03-24 16:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa1d561-6998-500a-ba5b-2baf1f539050 with identifier: 1980766
2026-03-24 16:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa1d561-6998-500a-ba5b-2baf1f539050 with scrape type 1
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/1.jpg not downloaded yet
2026-03-24 16:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b22628e1-0ca5-5ffe-aecf-f7ced62ed333 with identifier: 1980762
2026-03-24 16:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b22628e1-0ca5-5ffe-aecf-f7ced62ed333 with identifier: 1980762
2026-03-24 16:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b22628e1-0ca5-5ffe-aecf-f7ced62ed333 with identifier: 1980762 to the API
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b22628e1-0ca5-5ffe-aecf-f7ced62ed333',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 94445,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22628e1-0ca5-5ffe-aecf-f7ced62ed333/b22628e1-0ca5-5ffe-aecf-f7ced62ed333_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236458,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/aa86357524024bb89125b26374cea14f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-08',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai 1.3 Mild Hybrid 158ch Business Edition '
'Xtronic',
'transmission': 'automatic',
'trim': 'Qashqai 1.3 Mild Hybrid 158ch Business Edition Xtronic',
'vin': None,
'year': 2023}
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980762%27 HTTP/1.1" 200 None
2026-03-24 16:49:31 [ayvens.fr] INFO: Saving data for 1980762: {'created_time': 1774370971.66157, 'last_price_update_time': 1774370971.661582, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980762') HTTP/1.1" 204 0
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/2.jpg not downloaded yet
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8ad0>
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/2.jpg saved to cache
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/3.jpg not downloaded yet
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69a10>
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/3.jpg saved to cache
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb8c50>
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/8.jpg saved to cache
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccc850>
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/7.jpg saved to cache
2026-03-24 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d31d0>
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/7.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/4.jpg not downloaded yet
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a4d90>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/6.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613de10>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/5.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d1d0>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/4.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/5.jpg not downloaded yet
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/6.jpg not downloaded yet
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd0c10>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/1.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/7.jpg not downloaded yet
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/8.jpg not downloaded yet
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708b10>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/6.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56dbed0>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/3.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [ayvens.fr] INFO: Found listing with ID: 1980767
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980767%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [ayvens.fr] INFO: Scrape type for 1980767: 1
2026-03-24 16:49:32 [ayvens.fr] INFO: Extracting data for car ID: 1980767
2026-03-24 16:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f442236e-d0bf-50d8-a513-9f58d205186f with identifier: 1980767
2026-03-24 16:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f442236e-d0bf-50d8-a513-9f58d205186f with scrape type 1
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/1.jpg not downloaded yet
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/2.jpg not downloaded yet
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/3.jpg not downloaded yet
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be1010>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/2.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d61410>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/3.jpg saved to cache
2026-03-24 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b85c50>
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/1.jpg saved to cache
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f190>
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/2.jpg saved to cache
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b84d90>
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ff7ff686cc5334930bbce77c0df459eb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/8.jpg saved to cache
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0
2026-03-24 16:49:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc9fcbb1-1c07-5968-8fea-b7672c8647d0, skipping ID generation
2026-03-24 16:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0 with scrape type 1
2026-03-24 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc9fcbb1-1c07-5968-8fea-b7672c8647d0 sending to next pipeline
2026-03-24 16:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dc9fcbb1-1c07-5968-8fea-b7672c8647d0, identifier: 1980764
2026-03-24 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dc9fcbb1-1c07-5968-8fea-b7672c8647d0 with identifier: 1980764
2026-03-24 16:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dc9fcbb1-1c07-5968-8fea-b7672c8647d0 with identifier: 1980764
2026-03-24 16:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dc9fcbb1-1c07-5968-8fea-b7672c8647d0 with identifier: 1980764 to the API
2026-03-24 16:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'dc9fcbb1-1c07-5968-8fea-b7672c8647d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 62382,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9fcbb1-1c07-5968-8fea-b7672c8647d0/dc9fcbb1-1c07-5968-8fea-b7672c8647d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/f7ff686cc5334930bbce77c0df459eb7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2022}
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980764%27 HTTP/1.1" 200 None
2026-03-24 16:49:34 [ayvens.fr] INFO: Saving data for 1980764: {'created_time': 1774370974.785507, 'last_price_update_time': 1774370974.785518, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980764') HTTP/1.1" 204 0
2026-03-24 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/4.jpg not downloaded yet
2026-03-24 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/5.jpg not downloaded yet
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce2890>
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/6.jpg saved to cache
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e18790>
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/5.jpg saved to cache
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bcab50>
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F566684a3c7dc485f8f9514a0af9ceaa1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/4.jpg saved to cache
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c15ee1db-872a-5f7a-b3a0-e05536c9097f
2026-03-24 16:49:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c15ee1db-872a-5f7a-b3a0-e05536c9097f, skipping ID generation
2026-03-24 16:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15ee1db-872a-5f7a-b3a0-e05536c9097f with scrape type 1
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c15ee1db-872a-5f7a-b3a0-e05536c9097f sending to next pipeline
2026-03-24 16:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c15ee1db-872a-5f7a-b3a0-e05536c9097f, identifier: 1980763
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a07350>
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/5.jpg saved to cache
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc1790>
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/7.jpg saved to cache
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb4fd0>
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/4.jpg saved to cache
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/6.jpg not downloaded yet
2026-03-24 16:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c15ee1db-872a-5f7a-b3a0-e05536c9097f with identifier: 1980763
2026-03-24 16:49:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c15ee1db-872a-5f7a-b3a0-e05536c9097f with identifier: 1980763
2026-03-24 16:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c15ee1db-872a-5f7a-b3a0-e05536c9097f with identifier: 1980763 to the API
2026-03-24 16:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'GRIS LUNAIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c15ee1db-872a-5f7a-b3a0-e05536c9097f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 62114,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15ee1db-872a-5f7a-b3a0-e05536c9097f/c15ee1db-872a-5f7a-b3a0-e05536c9097f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/566684a3c7dc485f8f9514a0af9ceaa1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus 1.5 EcoBlue 120ch ST-Line',
'transmission': 'manual',
'trim': 'Focus 1.5 EcoBlue 120ch ST-Line',
'vin': None,
'year': 2022}
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980763%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [ayvens.fr] INFO: Saving data for 1980763: {'created_time': 1774370976.10733, 'last_price_update_time': 1774370976.107341, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980763') HTTP/1.1" 204 0
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/7.jpg not downloaded yet
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6b590>
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fccad8285465348e0aa2952dc0a532b34%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/8.jpg saved to cache
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73b5a705-974f-59eb-b919-6588ec9bd924
2026-03-24 16:49:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73b5a705-974f-59eb-b919-6588ec9bd924, skipping ID generation
2026-03-24 16:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b5a705-974f-59eb-b919-6588ec9bd924 with scrape type 1
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73b5a705-974f-59eb-b919-6588ec9bd924 sending to next pipeline
2026-03-24 16:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 73b5a705-974f-59eb-b919-6588ec9bd924, identifier: 1980765
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 73b5a705-974f-59eb-b919-6588ec9bd924 with identifier: 1980765
2026-03-24 16:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 73b5a705-974f-59eb-b919-6588ec9bd924 with identifier: 1980765
2026-03-24 16:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 73b5a705-974f-59eb-b919-6588ec9bd924 with identifier: 1980765 to the API
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '73b5a705-974f-59eb-b919-6588ec9bd924',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'LEON ST',
'odometer': 152946,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73b5a705-974f-59eb-b919-6588ec9bd924/73b5a705-974f-59eb-b919-6588ec9bd924_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/ccad8285465348e0aa2952dc0a532b34/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT LEON ST Leon ST 1.5 TSI 150ch Xcellence',
'transmission': 'manual',
'trim': 'Leon ST 1.5 TSI 150ch Xcellence',
'vin': None,
'year': 2022}
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980765%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [ayvens.fr] INFO: Saving data for 1980765: {'created_time': 1774370976.677054, 'last_price_update_time': 1774370976.677066, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980765') HTTP/1.1" 204 0
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/8.jpg not downloaded yet
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69c50>
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/1.jpg saved to cache
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [ayvens.fr] INFO: Found listing with ID: 1980768
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980768%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [ayvens.fr] INFO: Scrape type for 1980768: 1
2026-03-24 16:49:36 [ayvens.fr] INFO: Extracting data for car ID: 1980768
2026-03-24 16:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c87b6be-8786-5a5f-8cc4-064bc142e2ae with identifier: 1980768
2026-03-24 16:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae with scrape type 1
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/1.jpg not downloaded yet
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff310>
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/5.jpg saved to cache
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/2.jpg not downloaded yet
2026-03-24 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/3.jpg not downloaded yet
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd60d0>
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/3.jpg saved to cache
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf2410>
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/4.jpg saved to cache
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c72b90>
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/7.jpg saved to cache
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87a90>
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/6.jpg saved to cache
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff110>
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/8.jpg saved to cache
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/4.jpg not downloaded yet
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/5.jpg not downloaded yet
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a710>
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F1be20078a42c45d29d1b3dff24beae71%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/2.jpg saved to cache
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fa1d561-6998-500a-ba5b-2baf1f539050
2026-03-24 16:49:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fa1d561-6998-500a-ba5b-2baf1f539050, skipping ID generation
2026-03-24 16:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa1d561-6998-500a-ba5b-2baf1f539050 with scrape type 1
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fa1d561-6998-500a-ba5b-2baf1f539050 sending to next pipeline
2026-03-24 16:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5fa1d561-6998-500a-ba5b-2baf1f539050, identifier: 1980766
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/6.jpg not downloaded yet
2026-03-24 16:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5fa1d561-6998-500a-ba5b-2baf1f539050 with identifier: 1980766
2026-03-24 16:49:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5fa1d561-6998-500a-ba5b-2baf1f539050 with identifier: 1980766
2026-03-24 16:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5fa1d561-6998-500a-ba5b-2baf1f539050 with identifier: 1980766 to the API
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': 'SAPHIRSCHWARZ M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '5fa1d561-6998-500a-ba5b-2baf1f539050',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 GRAN TOURER',
'odometer': 104313,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1d561-6998-500a-ba5b-2baf1f539050/5fa1d561-6998-500a-ba5b-2baf1f539050_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/1be20078a42c45d29d1b3dff24beae71/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-21',
'seats_number': 7,
'seller_name': None,
'title': 'BMW SERIE 2 GRAN TOURER Série 2 Gran Tourer 218iA 136ch Sport DKG7',
'transmission': 'automatic',
'trim': 'Série 2 Gran Tourer 218iA 136ch Sport DKG7',
'vin': None,
'year': 2022}
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980766%27 HTTP/1.1" 200 None
2026-03-24 16:49:37 [ayvens.fr] INFO: Saving data for 1980766: {'created_time': 1774370977.966, 'last_price_update_time': 1774370977.966013, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980766') HTTP/1.1" 204 0
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/7.jpg not downloaded yet
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d00e10>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/1.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcd350>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/5.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e890>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/4.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c89210>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/3.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57092d0>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/7.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/8.jpg not downloaded yet
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [ayvens.fr] INFO: Found listing with ID: 1980769
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980769%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [ayvens.fr] INFO: Scrape type for 1980769: 1
2026-03-24 16:49:38 [ayvens.fr] INFO: Extracting data for car ID: 1980769
2026-03-24 16:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5841bde-e713-5b97-b328-ffdec43cdbd0 with identifier: 1980769
2026-03-24 16:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5841bde-e713-5b97-b328-ffdec43cdbd0 with scrape type 1
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/1.jpg not downloaded yet
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dde5d0>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/2.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf41d0>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/6.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/2.jpg not downloaded yet
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621ee90>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/1.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce1510>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/2.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/3.jpg not downloaded yet
2026-03-24 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/4.jpg not downloaded yet
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bafe50>
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252Fb417d9db1b7040399b3a1a1258574966%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/8.jpg saved to cache
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f442236e-d0bf-50d8-a513-9f58d205186f
2026-03-24 16:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f442236e-d0bf-50d8-a513-9f58d205186f, skipping ID generation
2026-03-24 16:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f442236e-d0bf-50d8-a513-9f58d205186f with scrape type 1
2026-03-24 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f442236e-d0bf-50d8-a513-9f58d205186f sending to next pipeline
2026-03-24 16:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f442236e-d0bf-50d8-a513-9f58d205186f, identifier: 1980767
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff950>
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/3.jpg saved to cache
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f442236e-d0bf-50d8-a513-9f58d205186f with identifier: 1980767
2026-03-24 16:49:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f442236e-d0bf-50d8-a513-9f58d205186f with identifier: 1980767
2026-03-24 16:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f442236e-d0bf-50d8-a513-9f58d205186f with identifier: 1980767 to the API
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'NOIR METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'f442236e-d0bf-50d8-a513-9f58d205186f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 47701,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f442236e-d0bf-50d8-a513-9f58d205186f/f442236e-d0bf-50d8-a513-9f58d205186f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415191,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/b417d9db1b7040399b3a1a1258574966/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-16',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 PureTech 110ch Shine Business S&S EAT6 E6.d-TEMP - 2 '
'PLACES',
'transmission': 'automatic',
'trim': 'C3 PureTech 110ch Shine Business S&S EAT6 E6.d-TEMP - 2 PLACES',
'vin': None,
'year': 2019}
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980767%27 HTTP/1.1" 200 None
2026-03-24 16:49:39 [ayvens.fr] INFO: Saving data for 1980767: {'created_time': 1774370979.580037, 'last_price_update_time': 1774370979.580048, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980767') HTTP/1.1" 204 0
2026-03-24 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/5.jpg not downloaded yet
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce1010>
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/5.jpg saved to cache
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617f290>
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/4.jpg saved to cache
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d85350>
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/6.jpg saved to cache
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/6.jpg not downloaded yet
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e198d0>
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/7.jpg saved to cache
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/7.jpg not downloaded yet
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8306990>
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F39a2aceb57d84d269e662133715880ee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/8.jpg saved to cache
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae
2026-03-24 16:49:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c87b6be-8786-5a5f-8cc4-064bc142e2ae, skipping ID generation
2026-03-24 16:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae with scrape type 1
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c87b6be-8786-5a5f-8cc4-064bc142e2ae sending to next pipeline
2026-03-24 16:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1c87b6be-8786-5a5f-8cc4-064bc142e2ae, identifier: 1980768
2026-03-24 16:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1c87b6be-8786-5a5f-8cc4-064bc142e2ae with identifier: 1980768
2026-03-24 16:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1c87b6be-8786-5a5f-8cc4-064bc142e2ae with identifier: 1980768
2026-03-24 16:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1c87b6be-8786-5a5f-8cc4-064bc142e2ae with identifier: 1980768 to the API
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '1c87b6be-8786-5a5f-8cc4-064bc142e2ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 70801,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341790,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c87b6be-8786-5a5f-8cc4-064bc142e2ae/1c87b6be-8786-5a5f-8cc4-064bc142e2ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/39a2aceb57d84d269e662133715880ee/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-20',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT SCENIC Grand Scenic 1.7 Blue dCi 120ch Business EDC 7 '
'places',
'transmission': 'automatic',
'trim': 'Grand Scenic 1.7 Blue dCi 120ch Business EDC 7 places',
'vin': None,
'year': 2020}
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980768%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [ayvens.fr] INFO: Saving data for 1980768: {'created_time': 1774370980.747262, 'last_price_update_time': 1774370980.747277, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980768') HTTP/1.1" 204 0
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/8.jpg not downloaded yet
2026-03-24 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:40 [ayvens.fr] INFO: Found listing with ID: 1980770
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980770%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [ayvens.fr] INFO: Scrape type for 1980770: 1
2026-03-24 16:49:40 [ayvens.fr] INFO: Extracting data for car ID: 1980770
2026-03-24 16:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84d9a24-e4c4-52c2-84d9-63acc3cce695 with identifier: 1980770
2026-03-24 16:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84d9a24-e4c4-52c2-84d9-63acc3cce695 with scrape type 1
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/1.jpg not downloaded yet
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/2.jpg not downloaded yet
2026-03-24 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/3.jpg not downloaded yet
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/4.jpg not downloaded yet
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/5.jpg not downloaded yet
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/6.jpg not downloaded yet
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/7.jpg not downloaded yet
2026-03-24 16:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33690>
2026-03-24 16:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/1.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e0d0>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/2.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/8.jpg not downloaded yet
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79ffdd0>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/3.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e819de10>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/4.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050490>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/5.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [ayvens.fr] INFO: Found listing with ID: 1980771
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980771%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [ayvens.fr] INFO: Scrape type for 1980771: 1
2026-03-24 16:49:41 [ayvens.fr] INFO: Extracting data for car ID: 1980771
2026-03-24 16:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36da457d-0264-5e31-b4e6-6d2c8d20dd9b with identifier: 1980771
2026-03-24 16:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b with scrape type 1
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/1.jpg not downloaded yet
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/2.jpg not downloaded yet
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/3.jpg not downloaded yet
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/4.jpg not downloaded yet
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/5.jpg not downloaded yet
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d55c10>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/7.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/6.jpg not downloaded yet
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/7.jpg not downloaded yet
2026-03-24 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d57410>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/8.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7a610>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/1.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e44a50>
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F4e040829f07e4e48ac02529447b3b11e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/6.jpg saved to cache
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5841bde-e713-5b97-b328-ffdec43cdbd0
2026-03-24 16:49:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5841bde-e713-5b97-b328-ffdec43cdbd0, skipping ID generation
2026-03-24 16:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5841bde-e713-5b97-b328-ffdec43cdbd0 with scrape type 1
2026-03-24 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5841bde-e713-5b97-b328-ffdec43cdbd0 sending to next pipeline
2026-03-24 16:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c5841bde-e713-5b97-b328-ffdec43cdbd0, identifier: 1980769
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8306290>
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/3.jpg saved to cache
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d190>
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/2.jpg saved to cache
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad590>
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/4.jpg saved to cache
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5719490>
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/5.jpg saved to cache
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/8.jpg not downloaded yet
2026-03-24 16:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c5841bde-e713-5b97-b328-ffdec43cdbd0 with identifier: 1980769
2026-03-24 16:49:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c5841bde-e713-5b97-b328-ffdec43cdbd0 with identifier: 1980769
2026-03-24 16:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c5841bde-e713-5b97-b328-ffdec43cdbd0 with identifier: 1980769 to the API
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': 'GRIS ECLIPSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c5841bde-e713-5b97-b328-ffdec43cdbd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 29728,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5841bde-e713-5b97-b328-ffdec43cdbd0/c5841bde-e713-5b97-b328-ffdec43cdbd0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/4e040829f07e4e48ac02529447b3b11e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 265ch PHEV GT-Line Premium BVA6 4x4',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 265ch PHEV GT-Line Premium BVA6 4x4',
'vin': None,
'year': 2022}
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980769%27 HTTP/1.1" 200 None
2026-03-24 16:49:42 [ayvens.fr] INFO: Saving data for 1980769: {'created_time': 1774370982.772091, 'last_price_update_time': 1774370982.772102, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980769') HTTP/1.1" 204 0
2026-03-24 16:49:42 [ayvens.fr] INFO: Found listing with ID: 1980772
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980772%27 HTTP/1.1" 200 None
2026-03-24 16:49:42 [ayvens.fr] INFO: Scrape type for 1980772: 1
2026-03-24 16:49:42 [ayvens.fr] INFO: Extracting data for car ID: 1980772
2026-03-24 16:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 with identifier: 1980772
2026-03-24 16:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 with scrape type 1
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/1.jpg not downloaded yet
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/2.jpg not downloaded yet
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b86190>
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/6.jpg saved to cache
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb7a10>
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/8.jpg saved to cache
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/3.jpg not downloaded yet
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/4.jpg not downloaded yet
2026-03-24 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/5.jpg not downloaded yet
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/6.jpg not downloaded yet
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/7.jpg not downloaded yet
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/8.jpg not downloaded yet
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bfc90>
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb090809bbd754d34b5253b8aad00c12b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/7.jpg saved to cache
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b84d9a24-e4c4-52c2-84d9-63acc3cce695
2026-03-24 16:49:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b84d9a24-e4c4-52c2-84d9-63acc3cce695, skipping ID generation
2026-03-24 16:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84d9a24-e4c4-52c2-84d9-63acc3cce695 with scrape type 1
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b84d9a24-e4c4-52c2-84d9-63acc3cce695 sending to next pipeline
2026-03-24 16:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b84d9a24-e4c4-52c2-84d9-63acc3cce695, identifier: 1980770
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6043090>
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/1.jpg saved to cache
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb72d0>
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/4.jpg saved to cache
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e18290>
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/6.jpg saved to cache
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:43 [ayvens.fr] INFO: Found listing with ID: 1980773
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980773%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [ayvens.fr] INFO: Scrape type for 1980773: 1
2026-03-24 16:49:43 [ayvens.fr] INFO: Extracting data for car ID: 1980773
2026-03-24 16:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de77c07f-f1f7-5bc1-bd86-47f61231d1b5 with identifier: 1980773
2026-03-24 16:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5 with scrape type 1
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/1.jpg not downloaded yet
2026-03-24 16:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b84d9a24-e4c4-52c2-84d9-63acc3cce695 with identifier: 1980770
2026-03-24 16:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b84d9a24-e4c4-52c2-84d9-63acc3cce695 with identifier: 1980770
2026-03-24 16:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b84d9a24-e4c4-52c2-84d9-63acc3cce695 with identifier: 1980770 to the API
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'b84d9a24-e4c4-52c2-84d9-63acc3cce695',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 46059,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84d9a24-e4c4-52c2-84d9-63acc3cce695/b84d9a24-e4c4-52c2-84d9-63acc3cce695_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b090809bbd754d34b5253b8aad00c12b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 265ch PHEV GT-Line Premium Business '
'BVA6 4x4',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 265ch PHEV GT-Line Premium Business BVA6 4x4',
'vin': None,
'year': 2023}
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980770%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [ayvens.fr] INFO: Saving data for 1980770: {'created_time': 1774370984.053329, 'last_price_update_time': 1774370984.05334, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980770') HTTP/1.1" 204 0
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/2.jpg not downloaded yet
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cbab90>
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/2.jpg saved to cache
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cee150>
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/5.jpg saved to cache
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5db10>
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/3.jpg saved to cache
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77f50>
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/7.jpg saved to cache
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/3.jpg not downloaded yet
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/4.jpg not downloaded yet
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/5.jpg not downloaded yet
2026-03-24 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/6.jpg not downloaded yet
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/7.jpg not downloaded yet
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/8.jpg not downloaded yet
2026-03-24 16:49:44 [ayvens.fr] INFO: Found listing with ID: 1980774
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980774%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [ayvens.fr] INFO: Scrape type for 1980774: 1
2026-03-24 16:49:44 [ayvens.fr] INFO: Extracting data for car ID: 1980774
2026-03-24 16:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57172952-c9ca-588a-ba2f-a7d0d480bce7 with identifier: 1980774
2026-03-24 16:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57172952-c9ca-588a-ba2f-a7d0d480bce7 with scrape type 1
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/1.jpg not downloaded yet
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/2.jpg not downloaded yet
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddd090>
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/1.jpg saved to cache
2026-03-24 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/3.jpg not downloaded yet
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09810>
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/3.jpg saved to cache
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ed610>
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/4.jpg saved to cache
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617ca90>
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/5.jpg saved to cache
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5a010>
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/2.jpg saved to cache
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0ed0>
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/6.jpg saved to cache
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611b790>
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd63917cb2795484ba7151c8e94f66cd3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/8.jpg saved to cache
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b
2026-03-24 16:49:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36da457d-0264-5e31-b4e6-6d2c8d20dd9b, skipping ID generation
2026-03-24 16:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b with scrape type 1
2026-03-24 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36da457d-0264-5e31-b4e6-6d2c8d20dd9b sending to next pipeline
2026-03-24 16:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 36da457d-0264-5e31-b4e6-6d2c8d20dd9b, identifier: 1980771
2026-03-24 16:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 36da457d-0264-5e31-b4e6-6d2c8d20dd9b with identifier: 1980771
2026-03-24 16:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 36da457d-0264-5e31-b4e6-6d2c8d20dd9b with identifier: 1980771
2026-03-24 16:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 36da457d-0264-5e31-b4e6-6d2c8d20dd9b with identifier: 1980771 to the API
2026-03-24 16:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '36da457d-0264-5e31-b4e6-6d2c8d20dd9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 51260,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36da457d-0264-5e31-b4e6-6d2c8d20dd9b/36da457d-0264-5e31-b4e6-6d2c8d20dd9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d63917cb2795484ba7151c8e94f66cd3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980771%27 HTTP/1.1" 200 None
2026-03-24 16:49:46 [ayvens.fr] INFO: Saving data for 1980771: {'created_time': 1774370986.20671, 'last_price_update_time': 1774370986.206724, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980771') HTTP/1.1" 204 0
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/4.jpg not downloaded yet
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573bc50>
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/7.jpg saved to cache
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/5.jpg not downloaded yet
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/6.jpg not downloaded yet
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b1c50>
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fdd88d88b9d304b748e8f936e515a7074%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/8.jpg saved to cache
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9
2026-03-24 16:49:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50cdd674-98f6-5d7d-bc9c-b769efa59ca9, skipping ID generation
2026-03-24 16:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 with scrape type 1
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 sending to next pipeline
2026-03-24 16:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 50cdd674-98f6-5d7d-bc9c-b769efa59ca9, identifier: 1980772
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3190>
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/3.jpg saved to cache
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0e7d0>
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/2.jpg saved to cache
2026-03-24 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 with identifier: 1980772
2026-03-24 16:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 with identifier: 1980772
2026-03-24 16:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 50cdd674-98f6-5d7d-bc9c-b769efa59ca9 with identifier: 1980772 to the API
2026-03-24 16:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '50cdd674-98f6-5d7d-bc9c-b769efa59ca9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CORSA',
'odometer': 131060,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cdd674-98f6-5d7d-bc9c-b769efa59ca9/50cdd674-98f6-5d7d-bc9c-b769efa59ca9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/dd88d88b9d304b748e8f936e515a7074/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seats_number': 2,
'seller_name': None,
'title': 'OPEL CORSA Corsa 1.5 D 100ch Edition Business // 2 PLACES - 2 '
'SEATS',
'transmission': 'manual',
'trim': 'Corsa 1.5 D 100ch Edition Business // 2 PLACES - 2 SEATS',
'vin': None,
'year': 2020}
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980772%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [ayvens.fr] INFO: Saving data for 1980772: {'created_time': 1774370987.385199, 'last_price_update_time': 1774370987.385214, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980772') HTTP/1.1" 204 0
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/7.jpg not downloaded yet
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e550>
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/6.jpg saved to cache
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5caf210>
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/1.jpg saved to cache
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103610>
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/5.jpg saved to cache
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c731d0>
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/4.jpg saved to cache
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09c10>
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/7.jpg saved to cache
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/8.jpg not downloaded yet
2026-03-24 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:47 [ayvens.fr] INFO: Found listing with ID: 1980775
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980775%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [ayvens.fr] INFO: Scrape type for 1980775: 1
2026-03-24 16:49:47 [ayvens.fr] INFO: Extracting data for car ID: 1980775
2026-03-24 16:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c05b70-3e6c-5913-b986-53269b85f6b1 with identifier: 1980775
2026-03-24 16:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c05b70-3e6c-5913-b986-53269b85f6b1 with scrape type 1
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/1.jpg not downloaded yet
2026-03-24 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/2.jpg not downloaded yet
2026-03-24 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/3.jpg not downloaded yet
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/4.jpg not downloaded yet
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/5.jpg not downloaded yet
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e666c050>
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/4.jpg saved to cache
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/6.jpg not downloaded yet
2026-03-24 16:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/7.jpg not downloaded yet
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d410>
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/1.jpg saved to cache
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81850>
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F18191449ed244f99866e7b17246a4c81%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/8.jpg saved to cache
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5
2026-03-24 16:49:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de77c07f-f1f7-5bc1-bd86-47f61231d1b5, skipping ID generation
2026-03-24 16:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5 with scrape type 1
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de77c07f-f1f7-5bc1-bd86-47f61231d1b5 sending to next pipeline
2026-03-24 16:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: de77c07f-f1f7-5bc1-bd86-47f61231d1b5, identifier: 1980773
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6100290>
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/3.jpg saved to cache
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c68150>
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/2.jpg saved to cache
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3690>
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/5.jpg saved to cache
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/8.jpg not downloaded yet
2026-03-24 16:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: de77c07f-f1f7-5bc1-bd86-47f61231d1b5 with identifier: 1980773
2026-03-24 16:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: de77c07f-f1f7-5bc1-bd86-47f61231d1b5 with identifier: 1980773
2026-03-24 16:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: de77c07f-f1f7-5bc1-bd86-47f61231d1b5 with identifier: 1980773 to the API
2026-03-24 16:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'de77c07f-f1f7-5bc1-bd86-47f61231d1b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 33539,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274483,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de77c07f-f1f7-5bc1-bd86-47f61231d1b5/de77c07f-f1f7-5bc1-bd86-47f61231d1b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/18191449ed244f99866e7b17246a4c81/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PARTNER Partner Long 1.6 BlueHDi 100ch Cabine Approfondie '
'Pro',
'transmission': 'manual',
'trim': 'Partner Long 1.6 BlueHDi 100ch Cabine Approfondie Pro',
'vin': None,
'year': 2018}
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980773%27 HTTP/1.1" 200 None
2026-03-24 16:49:49 [ayvens.fr] INFO: Saving data for 1980773: {'created_time': 1774370989.720717, 'last_price_update_time': 1774370989.72074, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980773') HTTP/1.1" 204 0
2026-03-24 16:49:49 [ayvens.fr] INFO: Found listing with ID: 1980776
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980776%27 HTTP/1.1" 200 None
2026-03-24 16:49:49 [ayvens.fr] INFO: Scrape type for 1980776: 1
2026-03-24 16:49:49 [ayvens.fr] INFO: Extracting data for car ID: 1980776
2026-03-24 16:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7878a3-e095-5bcd-b5e5-a46114986038 with identifier: 1980776
2026-03-24 16:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7878a3-e095-5bcd-b5e5-a46114986038 with scrape type 1
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/1.jpg not downloaded yet
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/2.jpg not downloaded yet
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60210>
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/6.jpg saved to cache
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d7390>
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/8.jpg saved to cache
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/3.jpg not downloaded yet
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/4.jpg not downloaded yet
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053fd0>
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fd861bd1e423e43e7ac21343de8ff42cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/7.jpg saved to cache
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57172952-c9ca-588a-ba2f-a7d0d480bce7
2026-03-24 16:49:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57172952-c9ca-588a-ba2f-a7d0d480bce7, skipping ID generation
2026-03-24 16:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57172952-c9ca-588a-ba2f-a7d0d480bce7 with scrape type 1
2026-03-24 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57172952-c9ca-588a-ba2f-a7d0d480bce7 sending to next pipeline
2026-03-24 16:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 57172952-c9ca-588a-ba2f-a7d0d480bce7, identifier: 1980774
2026-03-24 16:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/5.jpg not downloaded yet
2026-03-24 16:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 57172952-c9ca-588a-ba2f-a7d0d480bce7 with identifier: 1980774
2026-03-24 16:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 57172952-c9ca-588a-ba2f-a7d0d480bce7 with identifier: 1980774
2026-03-24 16:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 57172952-c9ca-588a-ba2f-a7d0d480bce7 with identifier: 1980774 to the API
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '57172952-c9ca-588a-ba2f-a7d0d480bce7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO',
'odometer': 29873,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391560,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57172952-c9ca-588a-ba2f-a7d0d480bce7/57172952-c9ca-588a-ba2f-a7d0d480bce7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/d861bd1e423e43e7ac21343de8ff42cc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-09',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO Kangoo Van L1 E-Tech EV45 dc 80kw Grand Confort',
'transmission': 'automatic',
'trim': 'Kangoo Van L1 E-Tech EV45 dc 80kw Grand Confort',
'vin': None,
'year': 2022}
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980774%27 HTTP/1.1" 200 None
2026-03-24 16:49:50 [ayvens.fr] INFO: Saving data for 1980774: {'created_time': 1774370990.501747, 'last_price_update_time': 1774370990.501762, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980774') HTTP/1.1" 204 0
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/6.jpg not downloaded yet
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1ab90>
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/1.jpg saved to cache
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573b310>
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/2.jpg saved to cache
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7d190>
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/4.jpg saved to cache
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb5050>
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/6.jpg saved to cache
2026-03-24 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d50d90>
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/5.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60524d0>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/3.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d7210>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/7.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/7.jpg not downloaded yet
2026-03-24 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/8.jpg not downloaded yet
2026-03-24 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:51 [ayvens.fr] INFO: Found listing with ID: 1980777
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980777%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [ayvens.fr] INFO: Scrape type for 1980777: 1
2026-03-24 16:49:51 [ayvens.fr] INFO: Extracting data for car ID: 1980777
2026-03-24 16:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62277d8d-bac7-57d0-8f07-cec949996ed0 with identifier: 1980777
2026-03-24 16:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62277d8d-bac7-57d0-8f07-cec949996ed0 with scrape type 1
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/1.jpg not downloaded yet
2026-03-24 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/2.jpg not downloaded yet
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/3.jpg not downloaded yet
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/4.jpg not downloaded yet
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459eb50>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/1.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf2b10>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/2.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/5.jpg not downloaded yet
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/6.jpg not downloaded yet
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87f50>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F0ed9b28d026e4cd9bcf427c959096bc2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/8.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53c05b70-3e6c-5913-b986-53269b85f6b1
2026-03-24 16:49:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53c05b70-3e6c-5913-b986-53269b85f6b1, skipping ID generation
2026-03-24 16:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c05b70-3e6c-5913-b986-53269b85f6b1 with scrape type 1
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53c05b70-3e6c-5913-b986-53269b85f6b1 sending to next pipeline
2026-03-24 16:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 53c05b70-3e6c-5913-b986-53269b85f6b1, identifier: 1980775
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7ff50>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/3.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a810>
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/4.jpg saved to cache
2026-03-24 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 53c05b70-3e6c-5913-b986-53269b85f6b1 with identifier: 1980775
2026-03-24 16:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 53c05b70-3e6c-5913-b986-53269b85f6b1 with identifier: 1980775
2026-03-24 16:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 53c05b70-3e6c-5913-b986-53269b85f6b1 with identifier: 1980775 to the API
2026-03-24 16:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '53c05b70-3e6c-5913-b986-53269b85f6b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 11941,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346662,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c05b70-3e6c-5913-b986-53269b85f6b1/53c05b70-3e6c-5913-b986-53269b85f6b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/0ed9b28d026e4cd9bcf427c959096bc2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance',
'vin': None,
'year': 2023}
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980775%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [ayvens.fr] INFO: Saving data for 1980775: {'created_time': 1774370992.356693, 'last_price_update_time': 1774370992.356709, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980775') HTTP/1.1" 204 0
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/7.jpg not downloaded yet
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/8.jpg not downloaded yet
2026-03-24 16:49:52 [ayvens.fr] INFO: Found listing with ID: 1980778
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980778%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [ayvens.fr] INFO: Scrape type for 1980778: 1
2026-03-24 16:49:52 [ayvens.fr] INFO: Extracting data for car ID: 1980778
2026-03-24 16:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fced8c3-7d59-5e3c-aa78-19da8948bc98 with identifier: 1980778
2026-03-24 16:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98 with scrape type 1
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/1.jpg not downloaded yet
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/2.jpg not downloaded yet
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/3.jpg not downloaded yet
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/4.jpg not downloaded yet
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b0290>
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/8.jpg saved to cache
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b56f50>
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/7.jpg saved to cache
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60525d0>
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/5.jpg saved to cache
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9990>
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/1.jpg saved to cache
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce89d0>
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F4f38c791147c40e7afc40407d6e5662f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/6.jpg saved to cache
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a7878a3-e095-5bcd-b5e5-a46114986038
2026-03-24 16:49:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a7878a3-e095-5bcd-b5e5-a46114986038, skipping ID generation
2026-03-24 16:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7878a3-e095-5bcd-b5e5-a46114986038 with scrape type 1
2026-03-24 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a7878a3-e095-5bcd-b5e5-a46114986038 sending to next pipeline
2026-03-24 16:49:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7a7878a3-e095-5bcd-b5e5-a46114986038, identifier: 1980776
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd6e10>
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/2.jpg saved to cache
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/5.jpg not downloaded yet
2026-03-24 16:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7a7878a3-e095-5bcd-b5e5-a46114986038 with identifier: 1980776
2026-03-24 16:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7a7878a3-e095-5bcd-b5e5-a46114986038 with identifier: 1980776
2026-03-24 16:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7a7878a3-e095-5bcd-b5e5-a46114986038 with identifier: 1980776 to the API
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '7a7878a3-e095-5bcd-b5e5-a46114986038',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 30285,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7878a3-e095-5bcd-b5e5-a46114986038/7a7878a3-e095-5bcd-b5e5-a46114986038_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/4f38c791147c40e7afc40407d6e5662f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 265ch PHEV Active Business BVA6 4x4',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 265ch PHEV Active Business BVA6 4x4',
'vin': None,
'year': 2023}
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980776%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [ayvens.fr] INFO: Saving data for 1980776: {'created_time': 1774370993.534049, 'last_price_update_time': 1774370993.534061, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980776') HTTP/1.1" 204 0
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/6.jpg not downloaded yet
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2f10>
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/3.jpg saved to cache
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d56d50>
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/4.jpg saved to cache
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/7.jpg not downloaded yet
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/8.jpg not downloaded yet
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [ayvens.fr] INFO: Found listing with ID: 1980779
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980779%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [ayvens.fr] INFO: Scrape type for 1980779: 1
2026-03-24 16:49:53 [ayvens.fr] INFO: Extracting data for car ID: 1980779
2026-03-24 16:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c37d0691-d2ad-542a-8ea9-fd4813070dd5 with identifier: 1980779
2026-03-24 16:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37d0691-d2ad-542a-8ea9-fd4813070dd5 with scrape type 1
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/1.jpg not downloaded yet
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/2.jpg not downloaded yet
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/3.jpg not downloaded yet
2026-03-24 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/4.jpg not downloaded yet
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7ebd0>
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/5.jpg saved to cache
2026-03-24 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/5.jpg not downloaded yet
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/6.jpg not downloaded yet
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dddd10>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/8.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d116d0>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/6.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1d910>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Ffdde9611943840dcadacbabda727cf69%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/7.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62277d8d-bac7-57d0-8f07-cec949996ed0
2026-03-24 16:49:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62277d8d-bac7-57d0-8f07-cec949996ed0, skipping ID generation
2026-03-24 16:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62277d8d-bac7-57d0-8f07-cec949996ed0 with scrape type 1
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62277d8d-bac7-57d0-8f07-cec949996ed0 sending to next pipeline
2026-03-24 16:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 62277d8d-bac7-57d0-8f07-cec949996ed0, identifier: 1980777
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb8710>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/1.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572e490>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/2.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd0490>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/3.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 62277d8d-bac7-57d0-8f07-cec949996ed0 with identifier: 1980777
2026-03-24 16:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 62277d8d-bac7-57d0-8f07-cec949996ed0 with identifier: 1980777
2026-03-24 16:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 62277d8d-bac7-57d0-8f07-cec949996ed0 with identifier: 1980777 to the API
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'GRIS PLATINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '62277d8d-bac7-57d0-8f07-cec949996ed0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 36350,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62277d8d-bac7-57d0-8f07-cec949996ed0/62277d8d-bac7-57d0-8f07-cec949996ed0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/fdde9611943840dcadacbabda727cf69/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-22',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.0 TCe 90ch Business N',
'transmission': 'manual',
'trim': 'Clio Réversible 1.0 TCe 90ch Business N',
'vin': None,
'year': 2021}
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980777%27 HTTP/1.1" 200 None
2026-03-24 16:49:54 [ayvens.fr] INFO: Saving data for 1980777: {'created_time': 1774370994.859847, 'last_price_update_time': 1774370994.859859, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980777') HTTP/1.1" 204 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/7.jpg not downloaded yet
2026-03-24 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/8.jpg not downloaded yet
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b2510>
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/4.jpg saved to cache
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:54 [ayvens.fr] INFO: Found listing with ID: 1980780
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980780%27 HTTP/1.1" 200 None
2026-03-24 16:49:54 [ayvens.fr] INFO: Scrape type for 1980780: 1
2026-03-24 16:49:54 [ayvens.fr] INFO: Extracting data for car ID: 1980780
2026-03-24 16:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd33c46-7c93-5637-bcfd-15df2fc438eb with identifier: 1980780
2026-03-24 16:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd33c46-7c93-5637-bcfd-15df2fc438eb with scrape type 1
2026-03-24 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/1.jpg not downloaded yet
2026-03-24 16:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/2.jpg not downloaded yet
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c70150>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/6.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0110>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/5.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/3.jpg not downloaded yet
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/4.jpg not downloaded yet
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccf5d0>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/2.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621ed90>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/7.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bba990>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F249881ca6366475faae7803545765c74%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/8.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98
2026-03-24 16:49:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fced8c3-7d59-5e3c-aa78-19da8948bc98, skipping ID generation
2026-03-24 16:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98 with scrape type 1
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fced8c3-7d59-5e3c-aa78-19da8948bc98 sending to next pipeline
2026-03-24 16:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3fced8c3-7d59-5e3c-aa78-19da8948bc98, identifier: 1980778
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8290>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/1.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456dd10>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/3.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07cd0>
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/4.jpg saved to cache
2026-03-24 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3fced8c3-7d59-5e3c-aa78-19da8948bc98 with identifier: 1980778
2026-03-24 16:49:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3fced8c3-7d59-5e3c-aa78-19da8948bc98 with identifier: 1980778
2026-03-24 16:49:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3fced8c3-7d59-5e3c-aa78-19da8948bc98 with identifier: 1980778 to the API
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '3fced8c3-7d59-5e3c-aa78-19da8948bc98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 83253,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fced8c3-7d59-5e3c-aa78-19da8948bc98/3fced8c3-7d59-5e3c-aa78-19da8948bc98_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/249881ca6366475faae7803545765c74/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-24',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980778%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [ayvens.fr] INFO: Saving data for 1980778: {'created_time': 1774370996.365045, 'last_price_update_time': 1774370996.36506, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980778') HTTP/1.1" 204 0
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/5.jpg not downloaded yet
2026-03-24 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/6.jpg not downloaded yet
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/7.jpg not downloaded yet
2026-03-24 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/8.jpg not downloaded yet
2026-03-24 16:49:56 [ayvens.fr] INFO: Found listing with ID: 1980781
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980781%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [ayvens.fr] INFO: Scrape type for 1980781: 1
2026-03-24 16:49:56 [ayvens.fr] INFO: Extracting data for car ID: 1980781
2026-03-24 16:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce2c734-1dc6-5e2d-a899-10fafb54e664 with identifier: 1980781
2026-03-24 16:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664 with scrape type 1
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/1.jpg not downloaded yet
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/2.jpg not downloaded yet
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/3.jpg not downloaded yet
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f5a90>
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/6.jpg saved to cache
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c80c10>
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/7.jpg saved to cache
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d11150>
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/5.jpg saved to cache
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb8f50>
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fc4fcc3f7436e4058808d4d6681d22e0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/8.jpg saved to cache
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c37d0691-d2ad-542a-8ea9-fd4813070dd5
2026-03-24 16:49:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c37d0691-d2ad-542a-8ea9-fd4813070dd5, skipping ID generation
2026-03-24 16:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37d0691-d2ad-542a-8ea9-fd4813070dd5 with scrape type 1
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c37d0691-d2ad-542a-8ea9-fd4813070dd5 sending to next pipeline
2026-03-24 16:49:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c37d0691-d2ad-542a-8ea9-fd4813070dd5, identifier: 1980779
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/4.jpg not downloaded yet
2026-03-24 16:49:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c37d0691-d2ad-542a-8ea9-fd4813070dd5 with identifier: 1980779
2026-03-24 16:49:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:49:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c37d0691-d2ad-542a-8ea9-fd4813070dd5 with identifier: 1980779
2026-03-24 16:49:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c37d0691-d2ad-542a-8ea9-fd4813070dd5 with identifier: 1980779 to the API
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 35,
'color': 'BLEU ECLIPSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c37d0691-d2ad-542a-8ea9-fd4813070dd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 80353,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c37d0691-d2ad-542a-8ea9-fd4813070dd5/c37d0691-d2ad-542a-8ea9-fd4813070dd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/c4fcc3f7436e4058808d4d6681d22e0a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid rechargeable 180ch Feel '
'ë-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid rechargeable 180ch Feel ë-EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980779%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [ayvens.fr] INFO: Saving data for 1980779: {'created_time': 1774370997.455812, 'last_price_update_time': 1774370997.455824, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980779') HTTP/1.1" 204 0
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/5.jpg not downloaded yet
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d606d0>
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/1.jpg saved to cache
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f6450>
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/2.jpg saved to cache
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/6.jpg not downloaded yet
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/7.jpg not downloaded yet
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/8.jpg not downloaded yet
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [ayvens.fr] INFO: Found listing with ID: 1980782
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980782%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [ayvens.fr] INFO: Scrape type for 1980782: 1
2026-03-24 16:49:57 [ayvens.fr] INFO: Extracting data for car ID: 1980782
2026-03-24 16:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eadb0de-471f-54c0-a1b9-46780685f587 with identifier: 1980782
2026-03-24 16:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eadb0de-471f-54c0-a1b9-46780685f587 with scrape type 1
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/1.jpg not downloaded yet
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/2.jpg not downloaded yet
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0dcd0>
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/6.jpg saved to cache
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b755d0>
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/8.jpg saved to cache
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/3.jpg not downloaded yet
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/4.jpg not downloaded yet
2026-03-24 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/5.jpg not downloaded yet
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b93d0>
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/3.jpg saved to cache
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6119d90>
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/5.jpg saved to cache
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d80d0>
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/4.jpg saved to cache
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68290>
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/1.jpg saved to cache
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d90d0>
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F235afd7b80bf4838b1a57a9d282bbf22%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/7.jpg saved to cache
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcd33c46-7c93-5637-bcfd-15df2fc438eb
2026-03-24 16:49:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcd33c46-7c93-5637-bcfd-15df2fc438eb, skipping ID generation
2026-03-24 16:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd33c46-7c93-5637-bcfd-15df2fc438eb with scrape type 1
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcd33c46-7c93-5637-bcfd-15df2fc438eb sending to next pipeline
2026-03-24 16:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dcd33c46-7c93-5637-bcfd-15df2fc438eb, identifier: 1980780
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7eddc90>
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/2.jpg saved to cache
2026-03-24 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dcd33c46-7c93-5637-bcfd-15df2fc438eb with identifier: 1980780
2026-03-24 16:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dcd33c46-7c93-5637-bcfd-15df2fc438eb with identifier: 1980780
2026-03-24 16:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dcd33c46-7c93-5637-bcfd-15df2fc438eb with identifier: 1980780 to the API
2026-03-24 16:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'dcd33c46-7c93-5637-bcfd-15df2fc438eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 14780,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd33c46-7c93-5637-bcfd-15df2fc438eb/dcd33c46-7c93-5637-bcfd-15df2fc438eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/235afd7b80bf4838b1a57a9d282bbf22/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980780%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [ayvens.fr] INFO: Saving data for 1980780: {'created_time': 1774370999.101926, 'last_price_update_time': 1774370999.101937, 'auction_closing_time': 1774605600.0}
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980780') HTTP/1.1" 204 0
2026-03-24 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/6.jpg not downloaded yet
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/7.jpg not downloaded yet
2026-03-24 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5050>
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/5.jpg saved to cache
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7f890>
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/4.jpg saved to cache
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050f90>
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/6.jpg saved to cache
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613ea50>
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/7.jpg saved to cache
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/8.jpg not downloaded yet
2026-03-24 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:59 [ayvens.fr] INFO: Found listing with ID: 1980783
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980783%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [ayvens.fr] INFO: Scrape type for 1980783: 1
2026-03-24 16:49:59 [ayvens.fr] INFO: Extracting data for car ID: 1980783
2026-03-24 16:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c8bd33d-4195-5a27-8256-0562b0544393 with identifier: 1980783
2026-03-24 16:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c8bd33d-4195-5a27-8256-0562b0544393 with scrape type 1
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/1.jpg not downloaded yet
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572d510>
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/3.jpg saved to cache
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d61890>
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F4a67e8194b994a4a961b16ed034fae52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/8.jpg saved to cache
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664
2026-03-24 16:49:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ce2c734-1dc6-5e2d-a899-10fafb54e664, skipping ID generation
2026-03-24 16:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664 with scrape type 1
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ce2c734-1dc6-5e2d-a899-10fafb54e664 sending to next pipeline
2026-03-24 16:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2ce2c734-1dc6-5e2d-a899-10fafb54e664, identifier: 1980781
2026-03-24 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/2.jpg not downloaded yet
2026-03-24 16:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2ce2c734-1dc6-5e2d-a899-10fafb54e664 with identifier: 1980781
2026-03-24 16:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2ce2c734-1dc6-5e2d-a899-10fafb54e664 with identifier: 1980781
2026-03-24 16:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2ce2c734-1dc6-5e2d-a899-10fafb54e664 with identifier: 1980781 to the API
2026-03-24 16:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '2ce2c734-1dc6-5e2d-a899-10fafb54e664',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'CX-30',
'odometer': 86499,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316617,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce2c734-1dc6-5e2d-a899-10fafb54e664/2ce2c734-1dc6-5e2d-a899-10fafb54e664_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/4a67e8194b994a4a961b16ed034fae52/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA CX-30 CX-30 2.0 e-SKYACTIV-X M-Hybrid 186ch Business '
'Executive BVA 20',
'transmission': 'automatic',
'trim': 'CX-30 2.0 e-SKYACTIV-X M-Hybrid 186ch Business Executive BVA 20',
'vin': None,
'year': 2023}
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980781%27 HTTP/1.1" 200 None
2026-03-24 16:50:00 [ayvens.fr] INFO: Saving data for 1980781: {'created_time': 1774371000.281562, 'last_price_update_time': 1774371000.281574, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980781') HTTP/1.1" 204 0
2026-03-24 16:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/3.jpg not downloaded yet
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570ff50>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/1.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d321d0>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/2.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce1090>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/3.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d32ad0>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/5.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/4.jpg not downloaded yet
2026-03-24 16:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e6d0>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/4.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/5.jpg not downloaded yet
2026-03-24 16:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/6.jpg not downloaded yet
2026-03-24 16:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08f10>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/6.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/7.jpg not downloaded yet
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6095050>
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/7.jpg saved to cache
2026-03-24 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/8.jpg not downloaded yet
2026-03-24 16:50:01 [ayvens.fr] INFO: Found listing with ID: 1980784
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980784%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [ayvens.fr] INFO: Scrape type for 1980784: 1
2026-03-24 16:50:01 [ayvens.fr] INFO: Extracting data for car ID: 1980784
2026-03-24 16:50:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 with identifier: 1980784
2026-03-24 16:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 with scrape type 1
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/1.jpg not downloaded yet
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c62410>
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/1.jpg saved to cache
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d70390>
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc15d915196e444368d571acce4e892fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/8.jpg saved to cache
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1eadb0de-471f-54c0-a1b9-46780685f587
2026-03-24 16:50:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eadb0de-471f-54c0-a1b9-46780685f587, skipping ID generation
2026-03-24 16:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eadb0de-471f-54c0-a1b9-46780685f587 with scrape type 1
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1eadb0de-471f-54c0-a1b9-46780685f587 sending to next pipeline
2026-03-24 16:50:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1eadb0de-471f-54c0-a1b9-46780685f587, identifier: 1980782
2026-03-24 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1eadb0de-471f-54c0-a1b9-46780685f587 with identifier: 1980782
2026-03-24 16:50:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1eadb0de-471f-54c0-a1b9-46780685f587 with identifier: 1980782
2026-03-24 16:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1eadb0de-471f-54c0-a1b9-46780685f587 with identifier: 1980782 to the API
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '1eadb0de-471f-54c0-a1b9-46780685f587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 111966,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223424,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eadb0de-471f-54c0-a1b9-46780685f587/1eadb0de-471f-54c0-a1b9-46780685f587_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c15d915196e444368d571acce4e892fd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L1H1 1000 1.6 dCi 125ch energy Grand '
'Confort',
'transmission': 'manual',
'trim': 'Trafic Fg L1H1 1000 1.6 dCi 125ch energy Grand Confort',
'vin': None,
'year': 2019}
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980782%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [ayvens.fr] INFO: Saving data for 1980782: {'created_time': 1774371001.644558, 'last_price_update_time': 1774371001.644573, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980782') HTTP/1.1" 204 0
2026-03-24 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/2.jpg not downloaded yet
2026-03-24 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/3.jpg not downloaded yet
2026-03-24 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84e50>
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/2.jpg saved to cache
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/4.jpg not downloaded yet
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/5.jpg not downloaded yet
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459d410>
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/3.jpg saved to cache
2026-03-24 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570e690>
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/4.jpg saved to cache
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccca90>
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/5.jpg saved to cache
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570f690>
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/6.jpg saved to cache
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/6.jpg not downloaded yet
2026-03-24 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/7.jpg not downloaded yet
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456d3d0>
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/7.jpg saved to cache
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/8.jpg not downloaded yet
2026-03-24 16:50:02 [ayvens.fr] INFO: Found listing with ID: 1980785
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980785%27 HTTP/1.1" 200 None
2026-03-24 16:50:02 [ayvens.fr] INFO: Scrape type for 1980785: 1
2026-03-24 16:50:02 [ayvens.fr] INFO: Extracting data for car ID: 1980785
2026-03-24 16:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38de9bc-5b49-5a4c-8d8e-5a357461175b with identifier: 1980785
2026-03-24 16:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38de9bc-5b49-5a4c-8d8e-5a357461175b with scrape type 1
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/1.jpg not downloaded yet
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f3e10>
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F33236dc4864948c18f1c2f275585f5fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/8.jpg saved to cache
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c8bd33d-4195-5a27-8256-0562b0544393
2026-03-24 16:50:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c8bd33d-4195-5a27-8256-0562b0544393, skipping ID generation
2026-03-24 16:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c8bd33d-4195-5a27-8256-0562b0544393 with scrape type 1
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c8bd33d-4195-5a27-8256-0562b0544393 sending to next pipeline
2026-03-24 16:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7c8bd33d-4195-5a27-8256-0562b0544393, identifier: 1980783
2026-03-24 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/2.jpg not downloaded yet
2026-03-24 16:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7c8bd33d-4195-5a27-8256-0562b0544393 with identifier: 1980783
2026-03-24 16:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7c8bd33d-4195-5a27-8256-0562b0544393 with identifier: 1980783
2026-03-24 16:50:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7c8bd33d-4195-5a27-8256-0562b0544393 with identifier: 1980783 to the API
2026-03-24 16:50:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '7c8bd33d-4195-5a27-8256-0562b0544393',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 69180,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261614,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8bd33d-4195-5a27-8256-0562b0544393/7c8bd33d-4195-5a27-8256-0562b0544393_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/33236dc4864948c18f1c2f275585f5fd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 0.9 TCe 75ch energy Trend',
'transmission': 'manual',
'trim': 'Clio 0.9 TCe 75ch energy Trend',
'vin': None,
'year': 2019}
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980783%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [ayvens.fr] INFO: Saving data for 1980783: {'created_time': 1774371003.436097, 'last_price_update_time': 1774371003.436109, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980783') HTTP/1.1" 204 0
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/3.jpg not downloaded yet
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d010>
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/1.jpg saved to cache
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5d890>
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/2.jpg saved to cache
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d86190>
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/3.jpg saved to cache
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/4.jpg not downloaded yet
2026-03-24 16:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/5.jpg not downloaded yet
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/6.jpg not downloaded yet
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/7.jpg not downloaded yet
2026-03-24 16:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/8.jpg not downloaded yet
2026-03-24 16:50:03 [ayvens.fr] INFO: Found listing with ID: 1980786
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980786%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [ayvens.fr] INFO: Scrape type for 1980786: 1
2026-03-24 16:50:03 [ayvens.fr] INFO: Extracting data for car ID: 1980786
2026-03-24 16:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c481282-50f3-578b-a4c4-64bc91283c8d with identifier: 1980786
2026-03-24 16:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c481282-50f3-578b-a4c4-64bc91283c8d with scrape type 1
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/1.jpg not downloaded yet
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/2.jpg not downloaded yet
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cee050>
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/5.jpg saved to cache
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/3.jpg not downloaded yet
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605b190>
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/4.jpg saved to cache
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570fa90>
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/7.jpg saved to cache
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459f250>
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/6.jpg saved to cache
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/4.jpg not downloaded yet
2026-03-24 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/5.jpg not downloaded yet
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1e350>
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fb27328bec5a74a72b87c347a3eb1c15e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/8.jpg saved to cache
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1
2026-03-24 16:50:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5c7a11c-06a1-5000-b3d9-d0831e81a7c1, skipping ID generation
2026-03-24 16:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 with scrape type 1
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 sending to next pipeline
2026-03-24 16:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a5c7a11c-06a1-5000-b3d9-d0831e81a7c1, identifier: 1980784
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a07dd0>
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/1.jpg saved to cache
2026-03-24 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 with identifier: 1980784
2026-03-24 16:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 with identifier: 1980784
2026-03-24 16:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a5c7a11c-06a1-5000-b3d9-d0831e81a7c1 with identifier: 1980784 to the API
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'SAPHIR SCHWARZ METAL NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'a5c7a11c-06a1-5000-b3d9-d0831e81a7c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 47088,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c7a11c-06a1-5000-b3d9-d0831e81a7c1/a5c7a11c-06a1-5000-b3d9-d0831e81a7c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/b27328bec5a74a72b87c347a3eb1c15e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Série 1 118iA 136ch Edition Sport DKG7',
'transmission': 'automatic',
'trim': 'Série 1 118iA 136ch Edition Sport DKG7',
'vin': None,
'year': 2023}
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980784%27 HTTP/1.1" 200 None
2026-03-24 16:50:05 [ayvens.fr] INFO: Saving data for 1980784: {'created_time': 1774371005.068063, 'last_price_update_time': 1774371005.068074, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980784') HTTP/1.1" 204 0
2026-03-24 16:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/6.jpg not downloaded yet
2026-03-24 16:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc6b10>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/2.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e05f50>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/5.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce350>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/7.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/7.jpg not downloaded yet
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da5110>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/3.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfd9d0>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/4.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/8.jpg not downloaded yet
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7c790>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/6.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4c450>
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F94107040da86405fbf7008a9ef084f88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/8.jpg saved to cache
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a38de9bc-5b49-5a4c-8d8e-5a357461175b
2026-03-24 16:50:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a38de9bc-5b49-5a4c-8d8e-5a357461175b, skipping ID generation
2026-03-24 16:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38de9bc-5b49-5a4c-8d8e-5a357461175b with scrape type 1
2026-03-24 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a38de9bc-5b49-5a4c-8d8e-5a357461175b sending to next pipeline
2026-03-24 16:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a38de9bc-5b49-5a4c-8d8e-5a357461175b, identifier: 1980785
2026-03-24 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a38de9bc-5b49-5a4c-8d8e-5a357461175b with identifier: 1980785
2026-03-24 16:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a38de9bc-5b49-5a4c-8d8e-5a357461175b with identifier: 1980785
2026-03-24 16:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a38de9bc-5b49-5a4c-8d8e-5a357461175b with identifier: 1980785 to the API
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 234,
'color': None,
'currency': 'EUR',
'doors_number': 2,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'a38de9bc-5b49-5a4c-8d8e-5a357461175b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT',
'odometer': 28248,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a38de9bc-5b49-5a4c-8d8e-5a357461175b/a38de9bc-5b49-5a4c-8d8e-5a357461175b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/94107040da86405fbf7008a9ef084f88/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-01',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT Transit 2T CCb P350 L4 2.0 EcoBlue 130ch HDT S&S Trend '
'Business',
'transmission': 'manual',
'trim': 'Transit 2T CCb P350 L4 2.0 EcoBlue 130ch HDT S&S Trend Business',
'vin': None,
'year': 2024}
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980785%27 HTTP/1.1" 200 None
2026-03-24 16:50:06 [ayvens.fr] INFO: Saving data for 1980785: {'created_time': 1774371006.585549, 'last_price_update_time': 1774371006.58556, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980785') HTTP/1.1" 204 0
2026-03-24 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:06 [ayvens.fr] INFO: Found listing with ID: 1980787
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980787%27 HTTP/1.1" 200 None
2026-03-24 16:50:06 [ayvens.fr] INFO: Scrape type for 1980787: 1
2026-03-24 16:50:06 [ayvens.fr] INFO: Extracting data for car ID: 1980787
2026-03-24 16:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e7b26b-69fb-58af-99a8-8d23fe114012 with identifier: 1980787
2026-03-24 16:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e7b26b-69fb-58af-99a8-8d23fe114012 with scrape type 1
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/1.jpg not downloaded yet
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f27d0>
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/1.jpg saved to cache
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 2 pages/min), scraped 177 items (at 39 items/min)
2026-03-24 16:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/2.jpg not downloaded yet
2026-03-24 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6094cd0>
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/3.jpg saved to cache
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/3.jpg not downloaded yet
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d336d0>
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/2.jpg saved to cache
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/4.jpg not downloaded yet
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d62250>
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/4.jpg saved to cache
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61090>
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/5.jpg saved to cache
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/5.jpg not downloaded yet
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6042e90>
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/6.jpg saved to cache
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/6.jpg not downloaded yet
2026-03-24 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c62510>
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/7.jpg saved to cache
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/7.jpg not downloaded yet
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/8.jpg not downloaded yet
2026-03-24 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:07 [ayvens.fr] INFO: Found listing with ID: 1980788
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980788%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [ayvens.fr] INFO: Scrape type for 1980788: 1
2026-03-24 16:50:07 [ayvens.fr] INFO: Extracting data for car ID: 1980788
2026-03-24 16:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 with identifier: 1980788
2026-03-24 16:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 with scrape type 1
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/1.jpg not downloaded yet
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceb5d0>
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F713c581f895541ebb97e30c39690b569%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/8.jpg saved to cache
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c481282-50f3-578b-a4c4-64bc91283c8d
2026-03-24 16:50:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c481282-50f3-578b-a4c4-64bc91283c8d, skipping ID generation
2026-03-24 16:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c481282-50f3-578b-a4c4-64bc91283c8d with scrape type 1
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c481282-50f3-578b-a4c4-64bc91283c8d sending to next pipeline
2026-03-24 16:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4c481282-50f3-578b-a4c4-64bc91283c8d, identifier: 1980786
2026-03-24 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/2.jpg not downloaded yet
2026-03-24 16:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4c481282-50f3-578b-a4c4-64bc91283c8d with identifier: 1980786
2026-03-24 16:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4c481282-50f3-578b-a4c4-64bc91283c8d with identifier: 1980786
2026-03-24 16:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4c481282-50f3-578b-a4c4-64bc91283c8d with identifier: 1980786 to the API
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4c481282-50f3-578b-a4c4-64bc91283c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 12895,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282950,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c481282-50f3-578b-a4c4-64bc91283c8d/4c481282-50f3-578b-a4c4-64bc91283c8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390714,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/713c581f895541ebb97e30c39690b569/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine EAT6',
'transmission': 'automatic',
'trim': 'C3 1.2 PureTech 110ch S&S Shine EAT6',
'vin': None,
'year': 2023}
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980786%27 HTTP/1.1" 200 None
2026-03-24 16:50:07 [ayvens.fr] INFO: Saving data for 1980786: {'created_time': 1774371007.939478, 'last_price_update_time': 1774371007.939491, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980786') HTTP/1.1" 204 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/3.jpg not downloaded yet
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7fcd0>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/2.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd0950>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/1.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5727f50>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/3.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/4.jpg not downloaded yet
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/5.jpg not downloaded yet
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/6.jpg not downloaded yet
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/7.jpg not downloaded yet
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/8.jpg not downloaded yet
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [ayvens.fr] INFO: Found listing with ID: 1980789
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980789%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [ayvens.fr] INFO: Scrape type for 1980789: 1
2026-03-24 16:50:08 [ayvens.fr] INFO: Extracting data for car ID: 1980789
2026-03-24 16:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb5c599-4adb-52e0-a715-4edfa441fced with identifier: 1980789
2026-03-24 16:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb5c599-4adb-52e0-a715-4edfa441fced with scrape type 1
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/1.jpg not downloaded yet
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/2.jpg not downloaded yet
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a14d0>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/4.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce1650>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/7.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb8690>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/5.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/3.jpg not downloaded yet
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81910>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/6.jpg saved to cache
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/4.jpg not downloaded yet
2026-03-24 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/5.jpg not downloaded yet
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570db90>
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/1.jpg saved to cache
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce99d0>
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fd5ee3e9632034f8f97e20d273530bbda%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/8.jpg saved to cache
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75e7b26b-69fb-58af-99a8-8d23fe114012
2026-03-24 16:50:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75e7b26b-69fb-58af-99a8-8d23fe114012, skipping ID generation
2026-03-24 16:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e7b26b-69fb-58af-99a8-8d23fe114012 with scrape type 1
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75e7b26b-69fb-58af-99a8-8d23fe114012 sending to next pipeline
2026-03-24 16:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 75e7b26b-69fb-58af-99a8-8d23fe114012, identifier: 1980787
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 75e7b26b-69fb-58af-99a8-8d23fe114012 with identifier: 1980787
2026-03-24 16:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 75e7b26b-69fb-58af-99a8-8d23fe114012 with identifier: 1980787
2026-03-24 16:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 75e7b26b-69fb-58af-99a8-8d23fe114012 with identifier: 1980787 to the API
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 9,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '75e7b26b-69fb-58af-99a8-8d23fe114012',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 4101,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e7b26b-69fb-58af-99a8-8d23fe114012/75e7b26b-69fb-58af-99a8-8d23fe114012_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/d5ee3e9632034f8f97e20d273530bbda/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 1.5 eHybrid 204ch Life Plus DSG6',
'transmission': 'automatic',
'trim': 'Tiguan 1.5 eHybrid 204ch Life Plus DSG6',
'vin': None,
'year': 2025}
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980787%27 HTTP/1.1" 200 None
2026-03-24 16:50:09 [ayvens.fr] INFO: Saving data for 1980787: {'created_time': 1774371009.578271, 'last_price_update_time': 1774371009.578281, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980787') HTTP/1.1" 204 0
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/6.jpg not downloaded yet
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e04310>
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/7.jpg saved to cache
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/7.jpg not downloaded yet
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e68c2bd0>
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/8.jpg saved to cache
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/8.jpg not downloaded yet
2026-03-24 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:09 [ayvens.fr] INFO: Found listing with ID: 1980790
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980790%27 HTTP/1.1" 200 None
2026-03-24 16:50:09 [ayvens.fr] INFO: Scrape type for 1980790: 1
2026-03-24 16:50:09 [ayvens.fr] INFO: Extracting data for car ID: 1980790
2026-03-24 16:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9059a2d6-8e88-5112-a32b-b353d5466972 with identifier: 1980790
2026-03-24 16:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9059a2d6-8e88-5112-a32b-b353d5466972 with scrape type 1
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/1.jpg not downloaded yet
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7c890>
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/5.jpg saved to cache
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5719a10>
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/2.jpg saved to cache
2026-03-24 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7aad0>
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/6.jpg saved to cache
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053a50>
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/4.jpg saved to cache
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/2.jpg not downloaded yet
2026-03-24 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a310>
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F955b1dc93fdb4c868b9686334ea8361e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/3.jpg saved to cache
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542
2026-03-24 16:50:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542, skipping ID generation
2026-03-24 16:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 with scrape type 1
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 sending to next pipeline
2026-03-24 16:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542, identifier: 1980788
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d72050>
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/1.jpg saved to cache
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc2b10>
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/2.jpg saved to cache
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/3.jpg not downloaded yet
2026-03-24 16:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 with identifier: 1980788
2026-03-24 16:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 with identifier: 1980788
2026-03-24 16:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8a2f2fb2-1f96-5f20-a45e-fba5a32c6542 with identifier: 1980788 to the API
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '8a2f2fb2-1f96-5f20-a45e-fba5a32c6542',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 86777,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a2f2fb2-1f96-5f20-a45e-fba5a32c6542/8a2f2fb2-1f96-5f20-a45e-fba5a32c6542_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/955b1dc93fdb4c868b9686334ea8361e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross BlueHDi 130ch S&S Business EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980788%27 HTTP/1.1" 200 None
2026-03-24 16:50:10 [ayvens.fr] INFO: Saving data for 1980788: {'created_time': 1774371010.830038, 'last_price_update_time': 1774371010.830048, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980788') HTTP/1.1" 204 0
2026-03-24 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/4.jpg not downloaded yet
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7f490>
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/3.jpg saved to cache
2026-03-24 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/5.jpg not downloaded yet
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c06e90>
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/4.jpg saved to cache
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/6.jpg not downloaded yet
2026-03-24 16:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/7.jpg not downloaded yet
2026-03-24 16:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b57150>
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/5.jpg saved to cache
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d710d0>
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/6.jpg saved to cache
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b4210>
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/7.jpg saved to cache
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/8.jpg not downloaded yet
2026-03-24 16:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:11 [ayvens.fr] INFO: Found listing with ID: 1980791
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980791%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [ayvens.fr] INFO: Scrape type for 1980791: 1
2026-03-24 16:50:11 [ayvens.fr] INFO: Extracting data for car ID: 1980791
2026-03-24 16:50:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c489aa4d-31be-54c7-8cfd-a809c8667ead with identifier: 1980791
2026-03-24 16:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c489aa4d-31be-54c7-8cfd-a809c8667ead with scrape type 1
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/1.jpg not downloaded yet
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c61950>
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F06df98bfe9a5482c81732b8385c6b712%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/8.jpg saved to cache
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6eb5c599-4adb-52e0-a715-4edfa441fced
2026-03-24 16:50:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6eb5c599-4adb-52e0-a715-4edfa441fced, skipping ID generation
2026-03-24 16:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb5c599-4adb-52e0-a715-4edfa441fced with scrape type 1
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6eb5c599-4adb-52e0-a715-4edfa441fced sending to next pipeline
2026-03-24 16:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6eb5c599-4adb-52e0-a715-4edfa441fced, identifier: 1980789
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c61790>
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/1.jpg saved to cache
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/2.jpg not downloaded yet
2026-03-24 16:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6eb5c599-4adb-52e0-a715-4edfa441fced with identifier: 1980789
2026-03-24 16:50:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6eb5c599-4adb-52e0-a715-4edfa441fced with identifier: 1980789
2026-03-24 16:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6eb5c599-4adb-52e0-a715-4edfa441fced with identifier: 1980789 to the API
2026-03-24 16:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS CENDRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '6eb5c599-4adb-52e0-a715-4edfa441fced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'T-CROSS',
'odometer': 124033,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eb5c599-4adb-52e0-a715-4edfa441fced/6eb5c599-4adb-52e0-a715-4edfa441fced_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392925,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/06df98bfe9a5482c81732b8385c6b712/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN T-CROSS T-Cross 1.0 TSI 110ch Style',
'transmission': 'manual',
'trim': 'T-Cross 1.0 TSI 110ch Style',
'vin': None,
'year': 2023}
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980789%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [ayvens.fr] INFO: Saving data for 1980789: {'created_time': 1774371012.216327, 'last_price_update_time': 1774371012.216374, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980789') HTTP/1.1" 204 0
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a2b90>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/2.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/3.jpg not downloaded yet
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5718490>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/3.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/4.jpg not downloaded yet
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/5.jpg not downloaded yet
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/6.jpg not downloaded yet
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/7.jpg not downloaded yet
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a2210>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/4.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/8.jpg not downloaded yet
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613c690>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/5.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:12 [ayvens.fr] INFO: Found listing with ID: 1980792
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980792%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [ayvens.fr] INFO: Scrape type for 1980792: 1
2026-03-24 16:50:12 [ayvens.fr] INFO: Extracting data for car ID: 1980792
2026-03-24 16:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd with identifier: 1980792
2026-03-24 16:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd with scrape type 1
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/1.jpg not downloaded yet
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/2.jpg not downloaded yet
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a5d0>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/7.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def750>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/6.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/3.jpg not downloaded yet
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/4.jpg not downloaded yet
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571b250>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/1.jpg saved to cache
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/5.jpg not downloaded yet
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/6.jpg not downloaded yet
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570b010>
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fdd1765189c074ad88cd4efe91a0f5c70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/8.jpg saved to cache
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9059a2d6-8e88-5112-a32b-b353d5466972
2026-03-24 16:50:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9059a2d6-8e88-5112-a32b-b353d5466972, skipping ID generation
2026-03-24 16:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9059a2d6-8e88-5112-a32b-b353d5466972 with scrape type 1
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9059a2d6-8e88-5112-a32b-b353d5466972 sending to next pipeline
2026-03-24 16:50:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9059a2d6-8e88-5112-a32b-b353d5466972, identifier: 1980790
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bba550>
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/4.jpg saved to cache
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9fd90>
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/3.jpg saved to cache
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da72d0>
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/2.jpg saved to cache
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/7.jpg not downloaded yet
2026-03-24 16:50:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9059a2d6-8e88-5112-a32b-b353d5466972 with identifier: 1980790
2026-03-24 16:50:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9059a2d6-8e88-5112-a32b-b353d5466972 with identifier: 1980790
2026-03-24 16:50:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9059a2d6-8e88-5112-a32b-b353d5466972 with identifier: 1980790 to the API
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '9059a2d6-8e88-5112-a32b-b353d5466972',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 90948,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9059a2d6-8e88-5112-a32b-b353d5466972/9059a2d6-8e88-5112-a32b-b353d5466972_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/dd1765189c074ad88cd4efe91a0f5c70/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-09',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine EAT6 - 2 PLACES',
'transmission': 'automatic',
'trim': 'C3 1.2 PureTech 110ch S&S Shine EAT6 - 2 PLACES',
'vin': None,
'year': 2021}
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980790%27 HTTP/1.1" 200 None
2026-03-24 16:50:13 [ayvens.fr] INFO: Saving data for 1980790: {'created_time': 1774371013.784443, 'last_price_update_time': 1774371013.784454, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980790') HTTP/1.1" 204 0
2026-03-24 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/8.jpg not downloaded yet
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c1610>
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/5.jpg saved to cache
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81490>
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/7.jpg saved to cache
2026-03-24 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7d510>
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/6.jpg saved to cache
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4c5d0>
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F7743364bb4044668a40a68198d994043%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/8.jpg saved to cache
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c489aa4d-31be-54c7-8cfd-a809c8667ead
2026-03-24 16:50:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c489aa4d-31be-54c7-8cfd-a809c8667ead, skipping ID generation
2026-03-24 16:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c489aa4d-31be-54c7-8cfd-a809c8667ead with scrape type 1
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c489aa4d-31be-54c7-8cfd-a809c8667ead sending to next pipeline
2026-03-24 16:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c489aa4d-31be-54c7-8cfd-a809c8667ead, identifier: 1980791
2026-03-24 16:50:14 [ayvens.fr] INFO: Found listing with ID: 1980793
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980793%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [ayvens.fr] INFO: Scrape type for 1980793: 1
2026-03-24 16:50:14 [ayvens.fr] INFO: Extracting data for car ID: 1980793
2026-03-24 16:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff3198c-f44e-5108-b5b7-f1d81884f16f with identifier: 1980793
2026-03-24 16:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff3198c-f44e-5108-b5b7-f1d81884f16f with scrape type 1
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/1.jpg not downloaded yet
2026-03-24 16:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c489aa4d-31be-54c7-8cfd-a809c8667ead with identifier: 1980791
2026-03-24 16:50:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c489aa4d-31be-54c7-8cfd-a809c8667ead with identifier: 1980791
2026-03-24 16:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c489aa4d-31be-54c7-8cfd-a809c8667ead with identifier: 1980791 to the API
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'GRIS ATLAS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'c489aa4d-31be-54c7-8cfd-a809c8667ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 108759,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307037,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c489aa4d-31be-54c7-8cfd-a809c8667ead/c489aa4d-31be-54c7-8cfd-a809c8667ead_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/7743364bb4044668a40a68198d994043/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-12',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 Hybride 222ch Dynamic Business AWD-i',
'transmission': 'automatic',
'trim': 'RAV4 Hybride 222ch Dynamic Business AWD-i',
'vin': None,
'year': 2021}
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980791%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [ayvens.fr] INFO: Saving data for 1980791: {'created_time': 1774371014.552292, 'last_price_update_time': 1774371014.552304, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980791') HTTP/1.1" 204 0
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d7a10>
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/1.jpg saved to cache
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fe4d0>
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/2.jpg saved to cache
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/2.jpg not downloaded yet
2026-03-24 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/3.jpg not downloaded yet
2026-03-24 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/4.jpg not downloaded yet
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/5.jpg not downloaded yet
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/6.jpg not downloaded yet
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/7.jpg not downloaded yet
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/8.jpg not downloaded yet
2026-03-24 16:50:14 [ayvens.fr] INFO: Found listing with ID: 1980794
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980794%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [ayvens.fr] INFO: Scrape type for 1980794: 1
2026-03-24 16:50:14 [ayvens.fr] INFO: Extracting data for car ID: 1980794
2026-03-24 16:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8ae7e8-c807-5958-a041-60475b9f1f37 with identifier: 1980794
2026-03-24 16:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8ae7e8-c807-5958-a041-60475b9f1f37 with scrape type 1
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/1.jpg not downloaded yet
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/2.jpg not downloaded yet
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613f9d0>
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/4.jpg saved to cache
2026-03-24 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/3.jpg not downloaded yet
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf3550>
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/3.jpg saved to cache
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8290>
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/6.jpg saved to cache
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb6410>
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/5.jpg saved to cache
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d59a50>
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/7.jpg saved to cache
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/4.jpg not downloaded yet
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4cb10>
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F4aa228a09af94241a7f3a0e01dbf2ec9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/8.jpg saved to cache
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd
2026-03-24 16:50:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd, skipping ID generation
2026-03-24 16:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd with scrape type 1
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd sending to next pipeline
2026-03-24 16:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd, identifier: 1980792
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/5.jpg not downloaded yet
2026-03-24 16:50:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd with identifier: 1980792
2026-03-24 16:50:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd with identifier: 1980792
2026-03-24 16:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5d00e678-82cf-5a37-a4b7-3aed2e5c2edd with identifier: 1980792 to the API
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '5d00e678-82cf-5a37-a4b7-3aed2e5c2edd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 15467,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d00e678-82cf-5a37-a4b7-3aed2e5c2edd/5d00e678-82cf-5a37-a4b7-3aed2e5c2edd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/4aa228a09af94241a7f3a0e01dbf2ec9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ZOE Zoe Business charge normale R110 Achat Intégral',
'transmission': 'automatic',
'trim': 'Zoe Business charge normale R110 Achat Intégral',
'vin': None,
'year': 2020}
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980792%27 HTTP/1.1" 200 None
2026-03-24 16:50:15 [ayvens.fr] INFO: Saving data for 1980792: {'created_time': 1774371015.824153, 'last_price_update_time': 1774371015.824164, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980792') HTTP/1.1" 204 0
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/6.jpg not downloaded yet
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf5610>
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/4.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ce90>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/5.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6100e90>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/7.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d32b90>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/3.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82a50>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/6.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/7.jpg not downloaded yet
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/8.jpg not downloaded yet
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd29d0>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/2.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9d410>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/1.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4e950>
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fc6d788c82ee84c5a8b5565b67d370d1c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/8.jpg saved to cache
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aff3198c-f44e-5108-b5b7-f1d81884f16f
2026-03-24 16:50:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aff3198c-f44e-5108-b5b7-f1d81884f16f, skipping ID generation
2026-03-24 16:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff3198c-f44e-5108-b5b7-f1d81884f16f with scrape type 1
2026-03-24 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aff3198c-f44e-5108-b5b7-f1d81884f16f sending to next pipeline
2026-03-24 16:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aff3198c-f44e-5108-b5b7-f1d81884f16f, identifier: 1980793
2026-03-24 16:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aff3198c-f44e-5108-b5b7-f1d81884f16f with identifier: 1980793
2026-03-24 16:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aff3198c-f44e-5108-b5b7-f1d81884f16f with identifier: 1980793
2026-03-24 16:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aff3198c-f44e-5108-b5b7-f1d81884f16f with identifier: 1980793 to the API
2026-03-24 16:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.5L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'aff3198c-f44e-5108-b5b7-f1d81884f16f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 68608,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff3198c-f44e-5108-b5b7-f1d81884f16f/aff3198c-f44e-5108-b5b7-f1d81884f16f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/c6d788c82ee84c5a8b5565b67d370d1c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Long Range AWD',
'transmission': 'automatic',
'trim': 'Model Y Long Range AWD',
'vin': None,
'year': 2023}
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980793%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [ayvens.fr] INFO: Saving data for 1980793: {'created_time': 1774371017.229453, 'last_price_update_time': 1774371017.229467, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980793') HTTP/1.1" 204 0
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [ayvens.fr] INFO: Found listing with ID: 1980795
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980795%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [ayvens.fr] INFO: Scrape type for 1980795: 1
2026-03-24 16:50:17 [ayvens.fr] INFO: Extracting data for car ID: 1980795
2026-03-24 16:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9990f96-f854-5a55-a7fb-e2354ed8e26a with identifier: 1980795
2026-03-24 16:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9990f96-f854-5a55-a7fb-e2354ed8e26a with scrape type 1
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/1.jpg not downloaded yet
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/2.jpg not downloaded yet
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/3.jpg not downloaded yet
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/4.jpg not downloaded yet
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/5.jpg not downloaded yet
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/6.jpg not downloaded yet
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d70fd0>
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/2.jpg saved to cache
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d31f10>
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/1.jpg saved to cache
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/7.jpg not downloaded yet
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/8.jpg not downloaded yet
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613f810>
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/3.jpg saved to cache
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e1a010>
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/4.jpg saved to cache
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a05950>
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/6.jpg saved to cache
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba1090>
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/5.jpg saved to cache
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [ayvens.fr] INFO: Found listing with ID: 1980796
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980796%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [ayvens.fr] INFO: Scrape type for 1980796: 1
2026-03-24 16:50:17 [ayvens.fr] INFO: Extracting data for car ID: 1980796
2026-03-24 16:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e49db41b-0b4d-56eb-9eac-1a14d0af282e with identifier: 1980796
2026-03-24 16:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49db41b-0b4d-56eb-9eac-1a14d0af282e with scrape type 1
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/1.jpg not downloaded yet
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/2.jpg not downloaded yet
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/3.jpg not downloaded yet
2026-03-24 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/4.jpg not downloaded yet
2026-03-24 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/5.jpg not downloaded yet
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c794d0>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/7.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/6.jpg not downloaded yet
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/7.jpg not downloaded yet
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cea810>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F09f2433e6c5e4b728d967bdd71415637%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/8.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e8ae7e8-c807-5958-a041-60475b9f1f37
2026-03-24 16:50:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e8ae7e8-c807-5958-a041-60475b9f1f37, skipping ID generation
2026-03-24 16:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8ae7e8-c807-5958-a041-60475b9f1f37 with scrape type 1
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e8ae7e8-c807-5958-a041-60475b9f1f37 sending to next pipeline
2026-03-24 16:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8e8ae7e8-c807-5958-a041-60475b9f1f37, identifier: 1980794
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a0c750>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/1.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5b510>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/2.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19710>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/4.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd6110>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/6.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c3f50>
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/5.jpg saved to cache
2026-03-24 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8e8ae7e8-c807-5958-a041-60475b9f1f37 with identifier: 1980794
2026-03-24 16:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8e8ae7e8-c807-5958-a041-60475b9f1f37 with identifier: 1980794
2026-03-24 16:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8e8ae7e8-c807-5958-a041-60475b9f1f37 with identifier: 1980794 to the API
2026-03-24 16:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '8e8ae7e8-c807-5958-a041-60475b9f1f37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 108724,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e8ae7e8-c807-5958-a041-60475b9f1f37/8e8ae7e8-c807-5958-a041-60475b9f1f37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/09f2433e6c5e4b728d967bdd71415637/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.5 Blue dCi 95ch Business',
'transmission': 'manual',
'trim': 'Megane 1.5 Blue dCi 95ch Business',
'vin': None,
'year': 2020}
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980794%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [ayvens.fr] INFO: Saving data for 1980794: {'created_time': 1774371019.543273, 'last_price_update_time': 1774371019.543289, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980794') HTTP/1.1" 204 0
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5710>
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/3.jpg saved to cache
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/8.jpg not downloaded yet
2026-03-24 16:50:19 [ayvens.fr] INFO: Found listing with ID: 1980797
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980797%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [ayvens.fr] INFO: Scrape type for 1980797: 1
2026-03-24 16:50:19 [ayvens.fr] INFO: Extracting data for car ID: 1980797
2026-03-24 16:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d15ef4b1-739e-5a70-b604-8ef9bd61466d with identifier: 1980797
2026-03-24 16:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d15ef4b1-739e-5a70-b604-8ef9bd61466d with scrape type 1
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/1.jpg not downloaded yet
2026-03-24 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc3450>
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/8.jpg saved to cache
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/2.jpg not downloaded yet
2026-03-24 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/3.jpg not downloaded yet
2026-03-24 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/4.jpg not downloaded yet
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/5.jpg not downloaded yet
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc9d50>
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d44732ec534655b8e22d1272b5607e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/7.jpg saved to cache
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9990f96-f854-5a55-a7fb-e2354ed8e26a
2026-03-24 16:50:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9990f96-f854-5a55-a7fb-e2354ed8e26a, skipping ID generation
2026-03-24 16:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9990f96-f854-5a55-a7fb-e2354ed8e26a with scrape type 1
2026-03-24 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9990f96-f854-5a55-a7fb-e2354ed8e26a sending to next pipeline
2026-03-24 16:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d9990f96-f854-5a55-a7fb-e2354ed8e26a, identifier: 1980795
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/6.jpg not downloaded yet
2026-03-24 16:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d9990f96-f854-5a55-a7fb-e2354ed8e26a with identifier: 1980795
2026-03-24 16:50:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d9990f96-f854-5a55-a7fb-e2354ed8e26a with identifier: 1980795
2026-03-24 16:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d9990f96-f854-5a55-a7fb-e2354ed8e26a with identifier: 1980795 to the API
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS COMETE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'd9990f96-f854-5a55-a7fb-e2354ed8e26a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'EV6',
'odometer': 110490,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9990f96-f854-5a55-a7fb-e2354ed8e26a/d9990f96-f854-5a55-a7fb-e2354ed8e26a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d44732ec534655b8e22d1272b5607e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-02',
'seats_number': 5,
'seller_name': None,
'title': 'KIA EV6 EV6 229ch Air Active Business 2WD',
'transmission': 'automatic',
'trim': 'EV6 229ch Air Active Business 2WD',
'vin': None,
'year': 2023}
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980795%27 HTTP/1.1" 200 None
2026-03-24 16:50:20 [ayvens.fr] INFO: Saving data for 1980795: {'created_time': 1774371020.747558, 'last_price_update_time': 1774371020.74757, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980795') HTTP/1.1" 204 0
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/7.jpg not downloaded yet
2026-03-24 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/8.jpg not downloaded yet
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bc1d0>
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/3.jpg saved to cache
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56febd0>
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/4.jpg saved to cache
2026-03-24 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cba2d0>
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/5.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56ff610>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/1.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d0e10>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/2.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [ayvens.fr] INFO: Found listing with ID: 1980798
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980798%27 HTTP/1.1" 200 None
2026-03-24 16:50:21 [ayvens.fr] INFO: Scrape type for 1980798: 1
2026-03-24 16:50:21 [ayvens.fr] INFO: Extracting data for car ID: 1980798
2026-03-24 16:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b with identifier: 1980798
2026-03-24 16:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b with scrape type 1
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/1.jpg not downloaded yet
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/2.jpg not downloaded yet
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0cc10>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/7.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/3.jpg not downloaded yet
2026-03-24 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/4.jpg not downloaded yet
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d0c90>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/6.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7e690>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F31d595813d4f4552b3ee3515f87d42f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/8.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e49db41b-0b4d-56eb-9eac-1a14d0af282e
2026-03-24 16:50:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e49db41b-0b4d-56eb-9eac-1a14d0af282e, skipping ID generation
2026-03-24 16:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49db41b-0b4d-56eb-9eac-1a14d0af282e with scrape type 1
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e49db41b-0b4d-56eb-9eac-1a14d0af282e sending to next pipeline
2026-03-24 16:50:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e49db41b-0b4d-56eb-9eac-1a14d0af282e, identifier: 1980796
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09d90>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/4.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8bd0>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/3.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbbf10>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/1.jpg saved to cache
2026-03-24 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56c8e90>
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/2.jpg saved to cache
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/5.jpg not downloaded yet
2026-03-24 16:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e49db41b-0b4d-56eb-9eac-1a14d0af282e with identifier: 1980796
2026-03-24 16:50:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e49db41b-0b4d-56eb-9eac-1a14d0af282e with identifier: 1980796
2026-03-24 16:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e49db41b-0b4d-56eb-9eac-1a14d0af282e with identifier: 1980796 to the API
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'color': 'NOIR METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'e49db41b-0b4d-56eb-9eac-1a14d0af282e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'LYNK & CO',
'model': '01',
'odometer': 49521,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49db41b-0b4d-56eb-9eac-1a14d0af282e/e49db41b-0b4d-56eb-9eac-1a14d0af282e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/31d595813d4f4552b3ee3515f87d42f9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'LYNK & CO 01 1 1.5 PHEV 261ch DCTH 7',
'transmission': 'automatic',
'trim': '1 1.5 PHEV 261ch DCTH 7',
'vin': None,
'year': 2023}
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980796%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [ayvens.fr] INFO: Saving data for 1980796: {'created_time': 1774371022.555401, 'last_price_update_time': 1774371022.555413, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980796') HTTP/1.1" 204 0
2026-03-24 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/6.jpg not downloaded yet
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6051150>
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/5.jpg saved to cache
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/7.jpg not downloaded yet
2026-03-24 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/8.jpg not downloaded yet
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba1110>
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/6.jpg saved to cache
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:22 [ayvens.fr] INFO: Found listing with ID: 1980799
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980799%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [ayvens.fr] INFO: Scrape type for 1980799: 1
2026-03-24 16:50:22 [ayvens.fr] INFO: Extracting data for car ID: 1980799
2026-03-24 16:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03136bcb-46a2-50c8-9e48-d70fa78c20cc with identifier: 1980799
2026-03-24 16:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc with scrape type 1
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/1.jpg not downloaded yet
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/2.jpg not downloaded yet
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9ff50>
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/7.jpg saved to cache
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7d50>
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Ff42cf99a129348bf95cd607ed71cb9a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/8.jpg saved to cache
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d15ef4b1-739e-5a70-b604-8ef9bd61466d
2026-03-24 16:50:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d15ef4b1-739e-5a70-b604-8ef9bd61466d, skipping ID generation
2026-03-24 16:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d15ef4b1-739e-5a70-b604-8ef9bd61466d with scrape type 1
2026-03-24 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d15ef4b1-739e-5a70-b604-8ef9bd61466d sending to next pipeline
2026-03-24 16:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d15ef4b1-739e-5a70-b604-8ef9bd61466d, identifier: 1980797
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b57290>
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/2.jpg saved to cache
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aa9d0>
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/1.jpg saved to cache
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/3.jpg not downloaded yet
2026-03-24 16:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d15ef4b1-739e-5a70-b604-8ef9bd61466d with identifier: 1980797
2026-03-24 16:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d15ef4b1-739e-5a70-b604-8ef9bd61466d with identifier: 1980797
2026-03-24 16:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d15ef4b1-739e-5a70-b604-8ef9bd61466d with identifier: 1980797 to the API
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'd15ef4b1-739e-5a70-b604-8ef9bd61466d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 64964,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15ef4b1-739e-5a70-b604-8ef9bd61466d/d15ef4b1-739e-5a70-b604-8ef9bd61466d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/f42cf99a129348bf95cd607ed71cb9a7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S GT Line 124g',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 130ch S&S GT Line 124g',
'vin': None,
'year': 2020}
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980797%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [ayvens.fr] INFO: Saving data for 1980797: {'created_time': 1774371023.506727, 'last_price_update_time': 1774371023.506738, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980797') HTTP/1.1" 204 0
2026-03-24 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/4.jpg not downloaded yet
2026-03-24 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/5.jpg not downloaded yet
2026-03-24 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/6.jpg not downloaded yet
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/7.jpg not downloaded yet
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/8.jpg not downloaded yet
2026-03-24 16:50:23 [ayvens.fr] INFO: Found listing with ID: 1980800
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980800%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [ayvens.fr] INFO: Scrape type for 1980800: 1
2026-03-24 16:50:23 [ayvens.fr] INFO: Extracting data for car ID: 1980800
2026-03-24 16:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 with identifier: 1980800
2026-03-24 16:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 with scrape type 1
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/1.jpg not downloaded yet
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/2.jpg not downloaded yet
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60fd0>
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/4.jpg saved to cache
2026-03-24 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457f210>
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/3.jpg saved to cache
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1c7d0>
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/6.jpg saved to cache
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d016d0>
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/5.jpg saved to cache
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/3.jpg not downloaded yet
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572c590>
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/8.jpg saved to cache
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc0450>
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8c29608d7d614244b362e8b5f9410f3c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/7.jpg saved to cache
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b
2026-03-24 16:50:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b, skipping ID generation
2026-03-24 16:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b with scrape type 1
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b sending to next pipeline
2026-03-24 16:50:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b, identifier: 1980798
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/4.jpg not downloaded yet
2026-03-24 16:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b with identifier: 1980798
2026-03-24 16:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b with identifier: 1980798
2026-03-24 16:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0e81dfcd-1dfd-5227-84c0-d6bb4feb072b with identifier: 1980798 to the API
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '0e81dfcd-1dfd-5227-84c0-d6bb4feb072b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '508',
'odometer': 77504,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334178,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e81dfcd-1dfd-5227-84c0-d6bb4feb072b/0e81dfcd-1dfd-5227-84c0-d6bb4feb072b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8c29608d7d614244b362e8b5f9410f3c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 508 508 SW BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '508 SW BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980798%27 HTTP/1.1" 200 None
2026-03-24 16:50:24 [ayvens.fr] INFO: Saving data for 1980798: {'created_time': 1774371024.801281, 'last_price_update_time': 1774371024.801292, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980798') HTTP/1.1" 204 0
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/5.jpg not downloaded yet
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/6.jpg not downloaded yet
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d9110>
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/1.jpg saved to cache
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/7.jpg not downloaded yet
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd2bd0>
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/7.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccfdd0>
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/6.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/8.jpg not downloaded yet
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457fdd0>
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/5.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d0d90>
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/4.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d70f90>
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/8.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d12350>
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/2.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708c10>
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F6e9ee99eb765439da0fba150c30d85d6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/3.jpg saved to cache
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc
2026-03-24 16:50:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03136bcb-46a2-50c8-9e48-d70fa78c20cc, skipping ID generation
2026-03-24 16:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc with scrape type 1
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03136bcb-46a2-50c8-9e48-d70fa78c20cc sending to next pipeline
2026-03-24 16:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 03136bcb-46a2-50c8-9e48-d70fa78c20cc, identifier: 1980799
2026-03-24 16:50:25 [ayvens.fr] INFO: Found listing with ID: 1980801
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980801%27 HTTP/1.1" 200 None
2026-03-24 16:50:25 [ayvens.fr] INFO: Scrape type for 1980801: 1
2026-03-24 16:50:25 [ayvens.fr] INFO: Extracting data for car ID: 1980801
2026-03-24 16:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6a66887-0abd-5336-9be9-0f2ed0af674e with identifier: 1980801
2026-03-24 16:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a66887-0abd-5336-9be9-0f2ed0af674e with scrape type 1
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/1.jpg not downloaded yet
2026-03-24 16:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 03136bcb-46a2-50c8-9e48-d70fa78c20cc with identifier: 1980799
2026-03-24 16:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 03136bcb-46a2-50c8-9e48-d70fa78c20cc with identifier: 1980799
2026-03-24 16:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 03136bcb-46a2-50c8-9e48-d70fa78c20cc with identifier: 1980799 to the API
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 212,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '03136bcb-46a2-50c8-9e48-d70fa78c20cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 66312,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03136bcb-46a2-50c8-9e48-d70fa78c20cc/03136bcb-46a2-50c8-9e48-d70fa78c20cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/6e9ee99eb765439da0fba150c30d85d6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-13',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT MASTER Master CCb F3500 L3 2.3 dCi 130ch Grand Confort '
'Euro6',
'transmission': 'manual',
'trim': 'Master CCb F3500 L3 2.3 dCi 130ch Grand Confort Euro6',
'vin': None,
'year': 2019}
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980799%27 HTTP/1.1" 200 None
2026-03-24 16:50:25 [ayvens.fr] INFO: Saving data for 1980799: {'created_time': 1774371025.99394, 'last_price_update_time': 1774371025.993955, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980799') HTTP/1.1" 204 0
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/2.jpg not downloaded yet
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/3.jpg not downloaded yet
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/4.jpg not downloaded yet
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/5.jpg not downloaded yet
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/6.jpg not downloaded yet
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/7.jpg not downloaded yet
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d1f50>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/5.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/8.jpg not downloaded yet
2026-03-24 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:26 [ayvens.fr] INFO: Found listing with ID: 1980802
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980802%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [ayvens.fr] INFO: Scrape type for 1980802: 1
2026-03-24 16:50:26 [ayvens.fr] INFO: Extracting data for car ID: 1980802
2026-03-24 16:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 795a6ccc-0ecd-5146-a191-68f64910e728 with identifier: 1980802
2026-03-24 16:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 795a6ccc-0ecd-5146-a191-68f64910e728 with scrape type 1
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/1.jpg not downloaded yet
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571b410>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/1.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fb510>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/2.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb6850>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/4.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b2110>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/3.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45a7890>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/7.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4558a10>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/6.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/2.jpg not downloaded yet
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d29dd0>
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fed-%252F5fd11165aa6a405aa423050f36719897%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/8.jpg saved to cache
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0
2026-03-24 16:50:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0, skipping ID generation
2026-03-24 16:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 with scrape type 1
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 sending to next pipeline
2026-03-24 16:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0, identifier: 1980800
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/3.jpg not downloaded yet
2026-03-24 16:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 with identifier: 1980800
2026-03-24 16:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 with identifier: 1980800
2026-03-24 16:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0 with identifier: 1980800 to the API
2026-03-24 16:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 75164,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0/4ddd1eca-8af6-571c-a5e7-8a632c4fbcf0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ed-/5fd11165aa6a405aa423050f36719897/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.6 BlueHDi 100ch Active Business S&S',
'transmission': 'manual',
'trim': '2008 1.6 BlueHDi 100ch Active Business S&S',
'vin': None,
'year': 2016}
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980800%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [ayvens.fr] INFO: Saving data for 1980800: {'created_time': 1774371027.332834, 'last_price_update_time': 1774371027.332848, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980800') HTTP/1.1" 204 0
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/4.jpg not downloaded yet
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/5.jpg not downloaded yet
2026-03-24 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/6.jpg not downloaded yet
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/7.jpg not downloaded yet
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/8.jpg not downloaded yet
2026-03-24 16:50:27 [ayvens.fr] INFO: Found listing with ID: 1980803
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980803%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [ayvens.fr] INFO: Scrape type for 1980803: 1
2026-03-24 16:50:27 [ayvens.fr] INFO: Extracting data for car ID: 1980803
2026-03-24 16:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d63328c9-a4c6-5347-aa5a-3f4f505fc86c with identifier: 1980803
2026-03-24 16:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c with scrape type 1
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/1.jpg not downloaded yet
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/2.jpg not downloaded yet
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d28310>
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/3.jpg saved to cache
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce0ad0>
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/7.jpg saved to cache
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32490>
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/5.jpg saved to cache
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b4650>
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/1.jpg saved to cache
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5790>
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/2.jpg saved to cache
2026-03-24 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aa710>
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/4.jpg saved to cache
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32b90>
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/6.jpg saved to cache
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/3.jpg not downloaded yet
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf42d0>
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fa82a7534208448fe8641676e491d74e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/8.jpg saved to cache
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6a66887-0abd-5336-9be9-0f2ed0af674e
2026-03-24 16:50:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6a66887-0abd-5336-9be9-0f2ed0af674e, skipping ID generation
2026-03-24 16:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a66887-0abd-5336-9be9-0f2ed0af674e with scrape type 1
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6a66887-0abd-5336-9be9-0f2ed0af674e sending to next pipeline
2026-03-24 16:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f6a66887-0abd-5336-9be9-0f2ed0af674e, identifier: 1980801
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/4.jpg not downloaded yet
2026-03-24 16:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f6a66887-0abd-5336-9be9-0f2ed0af674e with identifier: 1980801
2026-03-24 16:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f6a66887-0abd-5336-9be9-0f2ed0af674e with identifier: 1980801
2026-03-24 16:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f6a66887-0abd-5336-9be9-0f2ed0af674e with identifier: 1980801 to the API
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'f6a66887-0abd-5336-9be9-0f2ed0af674e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 136565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360614,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6a66887-0abd-5336-9be9-0f2ed0af674e/f6a66887-0abd-5336-9be9-0f2ed0af674e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/a82a7534208448fe8641676e491d74e0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2020}
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980801%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [ayvens.fr] INFO: Saving data for 1980801: {'created_time': 1774371028.672137, 'last_price_update_time': 1774371028.67215, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980801') HTTP/1.1" 204 0
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/5.jpg not downloaded yet
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/6.jpg not downloaded yet
2026-03-24 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/7.jpg not downloaded yet
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/8.jpg not downloaded yet
2026-03-24 16:50:28 [ayvens.fr] INFO: Found listing with ID: 1980804
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980804%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [ayvens.fr] INFO: Scrape type for 1980804: 1
2026-03-24 16:50:28 [ayvens.fr] INFO: Extracting data for car ID: 1980804
2026-03-24 16:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde8ae4b-0df1-5c57-b413-537545f6cc90 with identifier: 1980804
2026-03-24 16:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde8ae4b-0df1-5c57-b413-537545f6cc90 with scrape type 1
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/1.jpg not downloaded yet
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/2.jpg not downloaded yet
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/3.jpg not downloaded yet
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cefe90>
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/4.jpg saved to cache
2026-03-24 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31f90>
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/5.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbbc10>
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/3.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/4.jpg not downloaded yet
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454ef10>
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/6.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d02bd0>
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/7.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d32310>
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/2.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0150>
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/8.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/5.jpg not downloaded yet
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fbad0>
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F66b103d23aba4bdfb0ddf502297381da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/1.jpg saved to cache
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 795a6ccc-0ecd-5146-a191-68f64910e728
2026-03-24 16:50:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 795a6ccc-0ecd-5146-a191-68f64910e728, skipping ID generation
2026-03-24 16:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 795a6ccc-0ecd-5146-a191-68f64910e728 with scrape type 1
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 795a6ccc-0ecd-5146-a191-68f64910e728 sending to next pipeline
2026-03-24 16:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 795a6ccc-0ecd-5146-a191-68f64910e728, identifier: 1980802
2026-03-24 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/6.jpg not downloaded yet
2026-03-24 16:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 795a6ccc-0ecd-5146-a191-68f64910e728 with identifier: 1980802
2026-03-24 16:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 795a6ccc-0ecd-5146-a191-68f64910e728 with identifier: 1980802
2026-03-24 16:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 795a6ccc-0ecd-5146-a191-68f64910e728 with identifier: 1980802 to the API
2026-03-24 16:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '795a6ccc-0ecd-5146-a191-68f64910e728',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 110257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_795a6ccc-0ecd-5146-a191-68f64910e728/795a6ccc-0ecd-5146-a191-68f64910e728_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334802,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/66b103d23aba4bdfb0ddf502297381da/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Allure',
'transmission': 'manual',
'trim': '3008 1.5 BlueHDi 130ch S&S Allure',
'vin': None,
'year': 2021}
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980802%27 HTTP/1.1" 200 None
2026-03-24 16:50:30 [ayvens.fr] INFO: Saving data for 1980802: {'created_time': 1774371030.447902, 'last_price_update_time': 1774371030.447913, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980802') HTTP/1.1" 204 0
2026-03-24 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/7.jpg not downloaded yet
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b57210>
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/1.jpg saved to cache
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf1310>
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/5.jpg saved to cache
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d73010>
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/6.jpg saved to cache
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629e490>
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/7.jpg saved to cache
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b62dd0>
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/8.jpg saved to cache
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/8.jpg not downloaded yet
2026-03-24 16:50:30 [ayvens.fr] INFO: Found listing with ID: 1980805
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980805%27 HTTP/1.1" 200 None
2026-03-24 16:50:30 [ayvens.fr] INFO: Scrape type for 1980805: 1
2026-03-24 16:50:30 [ayvens.fr] INFO: Extracting data for car ID: 1980805
2026-03-24 16:50:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb5011bc-0461-5ff1-a5aa-c008126bd5ab with identifier: 1980805
2026-03-24 16:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab with scrape type 1
2026-03-24 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/1.jpg not downloaded yet
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6095b50>
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/3.jpg saved to cache
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81890>
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/2.jpg saved to cache
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6b490>
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252F33fe30954332471fbd9db5e9c48637e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/4.jpg saved to cache
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c
2026-03-24 16:50:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d63328c9-a4c6-5347-aa5a-3f4f505fc86c, skipping ID generation
2026-03-24 16:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c with scrape type 1
2026-03-24 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d63328c9-a4c6-5347-aa5a-3f4f505fc86c sending to next pipeline
2026-03-24 16:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d63328c9-a4c6-5347-aa5a-3f4f505fc86c, identifier: 1980803
2026-03-24 16:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d63328c9-a4c6-5347-aa5a-3f4f505fc86c with identifier: 1980803
2026-03-24 16:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d63328c9-a4c6-5347-aa5a-3f4f505fc86c with identifier: 1980803
2026-03-24 16:50:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d63328c9-a4c6-5347-aa5a-3f4f505fc86c with identifier: 1980803 to the API
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': 'BLANC PUR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd63328c9-a4c6-5347-aa5a-3f4f505fc86c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 67860,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63328c9-a4c6-5347-aa5a-3f4f505fc86c/d63328c9-a4c6-5347-aa5a-3f4f505fc86c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/33fe30954332471fbd9db5e9c48637e5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h Dynamic Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h Dynamic Business 5p',
'vin': None,
'year': 2018}
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980803%27 HTTP/1.1" 200 None
2026-03-24 16:50:31 [ayvens.fr] INFO: Saving data for 1980803: {'created_time': 1774371031.968146, 'last_price_update_time': 1774371031.96816, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980803') HTTP/1.1" 204 0
2026-03-24 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/2.jpg not downloaded yet
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/3.jpg not downloaded yet
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/4.jpg not downloaded yet
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724d90>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/5.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7c190>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/1.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b2b10>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/4.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8aa50>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/3.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8a110>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/2.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/5.jpg not downloaded yet
2026-03-24 16:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/6.jpg not downloaded yet
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb9a10>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/6.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605a450>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/7.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/7.jpg not downloaded yet
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0650>
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fd82dda4b28bd4b89a63acb42fd0acd40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/8.jpg saved to cache
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cde8ae4b-0df1-5c57-b413-537545f6cc90
2026-03-24 16:50:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cde8ae4b-0df1-5c57-b413-537545f6cc90, skipping ID generation
2026-03-24 16:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde8ae4b-0df1-5c57-b413-537545f6cc90 with scrape type 1
2026-03-24 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cde8ae4b-0df1-5c57-b413-537545f6cc90 sending to next pipeline
2026-03-24 16:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cde8ae4b-0df1-5c57-b413-537545f6cc90, identifier: 1980804
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/8.jpg not downloaded yet
2026-03-24 16:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cde8ae4b-0df1-5c57-b413-537545f6cc90 with identifier: 1980804
2026-03-24 16:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cde8ae4b-0df1-5c57-b413-537545f6cc90 with identifier: 1980804
2026-03-24 16:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cde8ae4b-0df1-5c57-b413-537545f6cc90 with identifier: 1980804 to the API
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'cde8ae4b-0df1-5c57-b413-537545f6cc90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 92970,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde8ae4b-0df1-5c57-b413-537545f6cc90/cde8ae4b-0df1-5c57-b413-537545f6cc90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/d82dda4b28bd4b89a63acb42fd0acd40/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-05',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'vin': None,
'year': 2021}
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980804%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [ayvens.fr] INFO: Saving data for 1980804: {'created_time': 1774371033.473798, 'last_price_update_time': 1774371033.47381, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980804') HTTP/1.1" 204 0
2026-03-24 16:50:33 [ayvens.fr] INFO: Found listing with ID: 1980806
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980806%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [ayvens.fr] INFO: Scrape type for 1980806: 1
2026-03-24 16:50:33 [ayvens.fr] INFO: Extracting data for car ID: 1980806
2026-03-24 16:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e7c184-f59e-5eb3-8f67-6913317e53d7 with identifier: 1980806
2026-03-24 16:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e7c184-f59e-5eb3-8f67-6913317e53d7 with scrape type 1
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/1.jpg not downloaded yet
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5cbd0>
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/2.jpg saved to cache
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc0890>
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/1.jpg saved to cache
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/2.jpg not downloaded yet
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/3.jpg not downloaded yet
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d036d0>
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/4.jpg saved to cache
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/4.jpg not downloaded yet
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/5.jpg not downloaded yet
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ee910>
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/3.jpg saved to cache
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/6.jpg not downloaded yet
2026-03-24 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4c0d0>
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/5.jpg saved to cache
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/7.jpg not downloaded yet
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5727890>
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/6.jpg saved to cache
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7cfd0>
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/7.jpg saved to cache
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053410>
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F60456191a07847b0af9604b1a1d663ae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/8.jpg saved to cache
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab
2026-03-24 16:50:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb5011bc-0461-5ff1-a5aa-c008126bd5ab, skipping ID generation
2026-03-24 16:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab with scrape type 1
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb5011bc-0461-5ff1-a5aa-c008126bd5ab sending to next pipeline
2026-03-24 16:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: eb5011bc-0461-5ff1-a5aa-c008126bd5ab, identifier: 1980805
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/8.jpg not downloaded yet
2026-03-24 16:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: eb5011bc-0461-5ff1-a5aa-c008126bd5ab with identifier: 1980805
2026-03-24 16:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: eb5011bc-0461-5ff1-a5aa-c008126bd5ab with identifier: 1980805
2026-03-24 16:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: eb5011bc-0461-5ff1-a5aa-c008126bd5ab with identifier: 1980805 to the API
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'eb5011bc-0461-5ff1-a5aa-c008126bd5ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 95437,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb5011bc-0461-5ff1-a5aa-c008126bd5ab/eb5011bc-0461-5ff1-a5aa-c008126bd5ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/60456191a07847b0af9604b1a1d663ae/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid 5ch Business + e-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid 5ch Business + e-EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980805%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [ayvens.fr] INFO: Saving data for 1980805: {'created_time': 1774371034.668443, 'last_price_update_time': 1774371034.668456, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980805') HTTP/1.1" 204 0
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45992d0>
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/1.jpg saved to cache
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:34 [ayvens.fr] INFO: Found listing with ID: 1980807
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980807%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [ayvens.fr] INFO: Scrape type for 1980807: 1
2026-03-24 16:50:34 [ayvens.fr] INFO: Extracting data for car ID: 1980807
2026-03-24 16:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d7d2a1c-0278-5174-bd80-aeec09135f49 with identifier: 1980807
2026-03-24 16:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d7d2a1c-0278-5174-bd80-aeec09135f49 with scrape type 1
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/1.jpg not downloaded yet
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/2.jpg not downloaded yet
2026-03-24 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/3.jpg not downloaded yet
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/4.jpg not downloaded yet
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/5.jpg not downloaded yet
2026-03-24 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/6.jpg not downloaded yet
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c69d50>
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/3.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6043a10>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/2.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77210>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/4.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/7.jpg not downloaded yet
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/8.jpg not downloaded yet
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07f10>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/5.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d12010>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/6.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33f10>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/7.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [ayvens.fr] INFO: Found listing with ID: 1980808
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980808%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [ayvens.fr] INFO: Scrape type for 1980808: 1
2026-03-24 16:50:35 [ayvens.fr] INFO: Extracting data for car ID: 1980808
2026-03-24 16:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22294002-43c5-5b12-9094-e7226593ec8f with identifier: 1980808
2026-03-24 16:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22294002-43c5-5b12-9094-e7226593ec8f with scrape type 1
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/1.jpg not downloaded yet
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/2.jpg not downloaded yet
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/3.jpg not downloaded yet
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621da10>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F781b7026de2642a4a79bdc5a42fbc81e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/8.jpg saved to cache
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58e7c184-f59e-5eb3-8f67-6913317e53d7
2026-03-24 16:50:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58e7c184-f59e-5eb3-8f67-6913317e53d7, skipping ID generation
2026-03-24 16:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e7c184-f59e-5eb3-8f67-6913317e53d7 with scrape type 1
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58e7c184-f59e-5eb3-8f67-6913317e53d7 sending to next pipeline
2026-03-24 16:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 58e7c184-f59e-5eb3-8f67-6913317e53d7, identifier: 1980806
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 58e7c184-f59e-5eb3-8f67-6913317e53d7 with identifier: 1980806
2026-03-24 16:50:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 58e7c184-f59e-5eb3-8f67-6913317e53d7 with identifier: 1980806
2026-03-24 16:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 58e7c184-f59e-5eb3-8f67-6913317e53d7 with identifier: 1980806 to the API
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC PERLE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.5L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '58e7c184-f59e-5eb3-8f67-6913317e53d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 66847,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294339,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e7c184-f59e-5eb3-8f67-6913317e53d7/58e7c184-f59e-5eb3-8f67-6913317e53d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/781b7026de2642a4a79bdc5a42fbc81e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Long-Range Dual Motor AWD',
'transmission': 'automatic',
'trim': 'Model 3 Long-Range Dual Motor AWD',
'vin': None,
'year': 2021}
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980806%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [ayvens.fr] INFO: Saving data for 1980806: {'created_time': 1774371035.862785, 'last_price_update_time': 1774371035.862797, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980806') HTTP/1.1" 204 0
2026-03-24 16:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/4.jpg not downloaded yet
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33450>
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/1.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77350>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/3.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/5.jpg not downloaded yet
2026-03-24 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b56d50>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/2.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572d6d0>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/4.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e05090>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/5.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/6.jpg not downloaded yet
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d32ed0>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/6.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/7.jpg not downloaded yet
2026-03-24 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103a50>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/7.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/8.jpg not downloaded yet
2026-03-24 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:36 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-24 16:50:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5aa50>
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fba5b00e64fb84921954f7ddf8fe076fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/8.jpg saved to cache
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d7d2a1c-0278-5174-bd80-aeec09135f49
2026-03-24 16:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d7d2a1c-0278-5174-bd80-aeec09135f49, skipping ID generation
2026-03-24 16:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d7d2a1c-0278-5174-bd80-aeec09135f49 with scrape type 1
2026-03-24 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d7d2a1c-0278-5174-bd80-aeec09135f49 sending to next pipeline
2026-03-24 16:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6d7d2a1c-0278-5174-bd80-aeec09135f49, identifier: 1980807
2026-03-24 16:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6d7d2a1c-0278-5174-bd80-aeec09135f49 with identifier: 1980807
2026-03-24 16:50:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6d7d2a1c-0278-5174-bd80-aeec09135f49 with identifier: 1980807
2026-03-24 16:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6d7d2a1c-0278-5174-bd80-aeec09135f49 with identifier: 1980807 to the API
2026-03-24 16:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLEU VERTIGO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '6d7d2a1c-0278-5174-bd80-aeec09135f49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208',
'odometer': 12741,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536465,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d7d2a1c-0278-5174-bd80-aeec09135f49/6d7d2a1c-0278-5174-bd80-aeec09135f49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/ba5b00e64fb84921954f7ddf8fe076fd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-208 208 e-208 136ch GT',
'transmission': 'automatic',
'trim': '208 e-208 136ch GT',
'vin': None,
'year': 2024}
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980807%27 HTTP/1.1" 200 None
2026-03-24 16:50:37 [ayvens.fr] INFO: Saving data for 1980807: {'created_time': 1774371037.667164, 'last_price_update_time': 1774371037.667174, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980807') HTTP/1.1" 204 0
2026-03-24 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31950>
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/1.jpg saved to cache
2026-03-24 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6101e10>
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/3.jpg saved to cache
2026-03-24 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0cd0>
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/2.jpg saved to cache
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e816e010>
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/4.jpg saved to cache
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87c90>
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/5.jpg saved to cache
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9e990>
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/8.jpg saved to cache
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d868d0>
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/7.jpg saved to cache
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7c890>
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7d44f3e5d96a4255b6ef0cf1084e4fd9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/6.jpg saved to cache
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22294002-43c5-5b12-9094-e7226593ec8f
2026-03-24 16:50:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22294002-43c5-5b12-9094-e7226593ec8f, skipping ID generation
2026-03-24 16:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22294002-43c5-5b12-9094-e7226593ec8f with scrape type 1
2026-03-24 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22294002-43c5-5b12-9094-e7226593ec8f sending to next pipeline
2026-03-24 16:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 22294002-43c5-5b12-9094-e7226593ec8f, identifier: 1980808
2026-03-24 16:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 22294002-43c5-5b12-9094-e7226593ec8f with identifier: 1980808
2026-03-24 16:50:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 22294002-43c5-5b12-9094-e7226593ec8f with identifier: 1980808
2026-03-24 16:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 22294002-43c5-5b12-9094-e7226593ec8f with identifier: 1980808 to the API
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'VERT AVENTURINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '22294002-43c5-5b12-9094-e7226593ec8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 37840,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22294002-43c5-5b12-9094-e7226593ec8f/22294002-43c5-5b12-9094-e7226593ec8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295767,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7d44f3e5d96a4255b6ef0cf1084e4fd9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Motion',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Motion',
'vin': None,
'year': 2023}
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980808%27 HTTP/1.1" 200 None
2026-03-24 16:50:38 [ayvens.fr] INFO: Saving data for 1980808: {'created_time': 1774371038.994205, 'last_price_update_time': 1774371038.994216, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980808') HTTP/1.1" 204 0
2026-03-24 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 16:50:43 [ayvens.fr] INFO: Found listing with ID: 1980809
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980809%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [ayvens.fr] INFO: Scrape type for 1980809: 1
2026-03-24 16:50:43 [ayvens.fr] INFO: Extracting data for car ID: 1980809
2026-03-24 16:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e00afd-b23f-534a-bf78-c622dfcf3891 with identifier: 1980809
2026-03-24 16:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e00afd-b23f-534a-bf78-c622dfcf3891 with scrape type 1
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/1.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/2.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/3.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/4.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/5.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/6.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/7.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/8.jpg not downloaded yet
2026-03-24 16:50:43 [ayvens.fr] INFO: Found listing with ID: 1980810
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980810%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [ayvens.fr] INFO: Scrape type for 1980810: 1
2026-03-24 16:50:43 [ayvens.fr] INFO: Extracting data for car ID: 1980810
2026-03-24 16:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 439b8ad1-e0df-5351-9008-0d3baf734d16 with identifier: 1980810
2026-03-24 16:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439b8ad1-e0df-5351-9008-0d3baf734d16 with scrape type 1
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/1.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/2.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/3.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/4.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/5.jpg not downloaded yet
2026-03-24 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/6.jpg not downloaded yet
2026-03-24 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/7.jpg not downloaded yet
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/8.jpg not downloaded yet
2026-03-24 16:50:43 [ayvens.fr] INFO: Found listing with ID: 1980811
2026-03-24 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980811%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [ayvens.fr] INFO: Scrape type for 1980811: 1
2026-03-24 16:50:44 [ayvens.fr] INFO: Extracting data for car ID: 1980811
2026-03-24 16:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf with identifier: 1980811
2026-03-24 16:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf with scrape type 1
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/1.jpg not downloaded yet
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/2.jpg not downloaded yet
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d3750>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/1.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/3.jpg not downloaded yet
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8ad0>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/2.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d58e10>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/3.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/4.jpg not downloaded yet
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/5.jpg not downloaded yet
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053f90>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/5.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8a410>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/6.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5c6d0>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/8.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d26d0>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/7.jpg saved to cache
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/6.jpg not downloaded yet
2026-03-24 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/7.jpg not downloaded yet
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1ccd0>
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F3dff479e62e44dd9a3a86d8b99e44895%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/4.jpg saved to cache
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64e00afd-b23f-534a-bf78-c622dfcf3891
2026-03-24 16:50:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64e00afd-b23f-534a-bf78-c622dfcf3891, skipping ID generation
2026-03-24 16:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e00afd-b23f-534a-bf78-c622dfcf3891 with scrape type 1
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64e00afd-b23f-534a-bf78-c622dfcf3891 sending to next pipeline
2026-03-24 16:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 64e00afd-b23f-534a-bf78-c622dfcf3891, identifier: 1980809
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5ef10>
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/3.jpg saved to cache
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457cd90>
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/1.jpg saved to cache
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/8.jpg not downloaded yet
2026-03-24 16:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 64e00afd-b23f-534a-bf78-c622dfcf3891 with identifier: 1980809
2026-03-24 16:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 64e00afd-b23f-534a-bf78-c622dfcf3891 with identifier: 1980809
2026-03-24 16:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 64e00afd-b23f-534a-bf78-c622dfcf3891 with identifier: 1980809 to the API
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': None,
'currency': 'EUR',
'doors_number': 2,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '64e00afd-b23f-534a-bf78-c622dfcf3891',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT',
'odometer': 75969,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287957,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e00afd-b23f-534a-bf78-c622dfcf3891/64e00afd-b23f-534a-bf78-c622dfcf3891_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/3dff479e62e44dd9a3a86d8b99e44895/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-16',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT Transit 2T CCb P350 L3 2.0 EcoBlue 170ch S&S HDT Trend '
'Business',
'transmission': 'manual',
'trim': 'Transit 2T CCb P350 L3 2.0 EcoBlue 170ch S&S HDT Trend Business',
'vin': None,
'year': 2021}
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980809%27 HTTP/1.1" 200 None
2026-03-24 16:50:45 [ayvens.fr] INFO: Saving data for 1980809: {'created_time': 1774371045.568307, 'last_price_update_time': 1774371045.568318, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980809') HTTP/1.1" 204 0
2026-03-24 16:50:45 [ayvens.fr] INFO: Found listing with ID: 1980812
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980812%27 HTTP/1.1" 200 None
2026-03-24 16:50:45 [ayvens.fr] INFO: Scrape type for 1980812: 1
2026-03-24 16:50:45 [ayvens.fr] INFO: Extracting data for car ID: 1980812
2026-03-24 16:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a81070a-710a-5c2f-b47b-e1df4837f31e with identifier: 1980812
2026-03-24 16:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a81070a-710a-5c2f-b47b-e1df4837f31e with scrape type 1
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/1.jpg not downloaded yet
2026-03-24 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/2.jpg not downloaded yet
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6367f10>
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/2.jpg saved to cache
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7e8d0>
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/5.jpg saved to cache
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddd390>
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/4.jpg saved to cache
2026-03-24 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459fb10>
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/7.jpg saved to cache
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e572d910>
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/6.jpg saved to cache
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/3.jpg not downloaded yet
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/4.jpg not downloaded yet
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6364790>
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F99d0c1379cb5402a9c77cc08f364ab3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/8.jpg saved to cache
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 439b8ad1-e0df-5351-9008-0d3baf734d16
2026-03-24 16:50:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 439b8ad1-e0df-5351-9008-0d3baf734d16, skipping ID generation
2026-03-24 16:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439b8ad1-e0df-5351-9008-0d3baf734d16 with scrape type 1
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 439b8ad1-e0df-5351-9008-0d3baf734d16 sending to next pipeline
2026-03-24 16:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 439b8ad1-e0df-5351-9008-0d3baf734d16, identifier: 1980810
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/5.jpg not downloaded yet
2026-03-24 16:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 439b8ad1-e0df-5351-9008-0d3baf734d16 with identifier: 1980810
2026-03-24 16:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 439b8ad1-e0df-5351-9008-0d3baf734d16 with identifier: 1980810
2026-03-24 16:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 439b8ad1-e0df-5351-9008-0d3baf734d16 with identifier: 1980810 to the API
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '439b8ad1-e0df-5351-9008-0d3baf734d16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-2008',
'odometer': 63005,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439b8ad1-e0df-5351-9008-0d3baf734d16/439b8ad1-e0df-5351-9008-0d3baf734d16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/99d0c1379cb5402a9c77cc08f364ab3f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-2008 2008 e-2008 136ch Allure',
'transmission': 'automatic',
'trim': '2008 e-2008 136ch Allure',
'vin': None,
'year': 2022}
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980810%27 HTTP/1.1" 200 None
2026-03-24 16:50:46 [ayvens.fr] INFO: Saving data for 1980810: {'created_time': 1774371046.783861, 'last_price_update_time': 1774371046.783872, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980810') HTTP/1.1" 204 0
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/6.jpg not downloaded yet
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6096910>
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/3.jpg saved to cache
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613fd90>
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/4.jpg saved to cache
2026-03-24 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def590>
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/2.jpg saved to cache
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1e950>
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/1.jpg saved to cache
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/7.jpg not downloaded yet
2026-03-24 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/8.jpg not downloaded yet
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b08d0>
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/6.jpg saved to cache
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6366410>
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/7.jpg saved to cache
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61039d0>
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/5.jpg saved to cache
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:47 [ayvens.fr] INFO: Found listing with ID: 1980813
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980813%27 HTTP/1.1" 200 None
2026-03-24 16:50:47 [ayvens.fr] INFO: Scrape type for 1980813: 1
2026-03-24 16:50:47 [ayvens.fr] INFO: Extracting data for car ID: 1980813
2026-03-24 16:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b52b51-108c-55ad-b9eb-cc96ae633c50 with identifier: 1980813
2026-03-24 16:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b52b51-108c-55ad-b9eb-cc96ae633c50 with scrape type 1
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/1.jpg not downloaded yet
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/2.jpg not downloaded yet
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f88d0>
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F98227273234f4a8fb75205987d68a1ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/8.jpg saved to cache
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf
2026-03-24 16:50:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf, skipping ID generation
2026-03-24 16:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf with scrape type 1
2026-03-24 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf sending to next pipeline
2026-03-24 16:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf, identifier: 1980811
2026-03-24 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf with identifier: 1980811
2026-03-24 16:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf with identifier: 1980811
2026-03-24 16:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 86b4fdbc-875b-5bcb-b9e8-927d04feeeaf with identifier: 1980811 to the API
2026-03-24 16:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '86b4fdbc-875b-5bcb-b9e8-927d04feeeaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 55867,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b4fdbc-875b-5bcb-b9e8-927d04feeeaf/86b4fdbc-875b-5bcb-b9e8-927d04feeeaf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/98227273234f4a8fb75205987d68a1ff/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-11',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980811%27 HTTP/1.1" 200 None
2026-03-24 16:50:49 [ayvens.fr] INFO: Saving data for 1980811: {'created_time': 1774371049.559201, 'last_price_update_time': 1774371049.559211, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980811') HTTP/1.1" 204 0
2026-03-24 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/3.jpg not downloaded yet
2026-03-24 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fb190>
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/2.jpg saved to cache
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6b110>
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/1.jpg saved to cache
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/4.jpg not downloaded yet
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2fd0>
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/3.jpg saved to cache
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/5.jpg not downloaded yet
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6102f10>
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/5.jpg saved to cache
2026-03-24 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbb690>
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/6.jpg saved to cache
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/6.jpg not downloaded yet
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d30bd0>
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/4.jpg saved to cache
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d53550>
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/7.jpg saved to cache
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/7.jpg not downloaded yet
2026-03-24 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/8.jpg not downloaded yet
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbad90>
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F97eee70a22de4c69ad1fd9691574db6f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/8.jpg saved to cache
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a81070a-710a-5c2f-b47b-e1df4837f31e
2026-03-24 16:50:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a81070a-710a-5c2f-b47b-e1df4837f31e, skipping ID generation
2026-03-24 16:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a81070a-710a-5c2f-b47b-e1df4837f31e with scrape type 1
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a81070a-710a-5c2f-b47b-e1df4837f31e sending to next pipeline
2026-03-24 16:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4a81070a-710a-5c2f-b47b-e1df4837f31e, identifier: 1980812
2026-03-24 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:50 [ayvens.fr] INFO: Found listing with ID: 1980814
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980814%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [ayvens.fr] INFO: Scrape type for 1980814: 1
2026-03-24 16:50:50 [ayvens.fr] INFO: Extracting data for car ID: 1980814
2026-03-24 16:50:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a161c93-fad4-543b-ab01-69a76b2660af with identifier: 1980814
2026-03-24 16:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a161c93-fad4-543b-ab01-69a76b2660af with scrape type 1
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/1.jpg not downloaded yet
2026-03-24 16:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4a81070a-710a-5c2f-b47b-e1df4837f31e with identifier: 1980812
2026-03-24 16:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4a81070a-710a-5c2f-b47b-e1df4837f31e with identifier: 1980812
2026-03-24 16:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4a81070a-710a-5c2f-b47b-e1df4837f31e with identifier: 1980812 to the API
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4a81070a-710a-5c2f-b47b-e1df4837f31e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 93059,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306950,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a81070a-710a-5c2f-b47b-e1df4837f31e/4a81070a-710a-5c2f-b47b-e1df4837f31e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/97eee70a22de4c69ad1fd9691574db6f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg PureTech 110 S&S Driver',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg PureTech 110 S&S Driver',
'vin': None,
'year': 2020}
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980812%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [ayvens.fr] INFO: Saving data for 1980812: {'created_time': 1774371050.860484, 'last_price_update_time': 1774371050.860493, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980812') HTTP/1.1" 204 0
2026-03-24 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/2.jpg not downloaded yet
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8690>
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/1.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60110>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/2.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/3.jpg not downloaded yet
2026-03-24 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/4.jpg not downloaded yet
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d72dd0>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/4.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56da790>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/3.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/5.jpg not downloaded yet
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/6.jpg not downloaded yet
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d51e50>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/5.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56cbb90>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/6.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc3a50>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/7.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/7.jpg not downloaded yet
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0f50>
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fc0854ed1f8f148ceb85f347fe9f13ba9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/8.jpg saved to cache
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8b52b51-108c-55ad-b9eb-cc96ae633c50
2026-03-24 16:50:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8b52b51-108c-55ad-b9eb-cc96ae633c50, skipping ID generation
2026-03-24 16:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b52b51-108c-55ad-b9eb-cc96ae633c50 with scrape type 1
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8b52b51-108c-55ad-b9eb-cc96ae633c50 sending to next pipeline
2026-03-24 16:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d8b52b51-108c-55ad-b9eb-cc96ae633c50, identifier: 1980813
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/8.jpg not downloaded yet
2026-03-24 16:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d8b52b51-108c-55ad-b9eb-cc96ae633c50 with identifier: 1980813
2026-03-24 16:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d8b52b51-108c-55ad-b9eb-cc96ae633c50 with identifier: 1980813
2026-03-24 16:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d8b52b51-108c-55ad-b9eb-cc96ae633c50 with identifier: 1980813 to the API
2026-03-24 16:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS NUIT',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.5L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'd8b52b51-108c-55ad-b9eb-cc96ae633c50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 46062,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317614,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b52b51-108c-55ad-b9eb-cc96ae633c50/d8b52b51-108c-55ad-b9eb-cc96ae633c50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/c0854ed1f8f148ceb85f347fe9f13ba9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Performance PUP AWD Upgrade',
'transmission': 'automatic',
'trim': 'Model 3 Performance PUP AWD Upgrade',
'vin': None,
'year': 2020}
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980813%27 HTTP/1.1" 200 None
2026-03-24 16:50:52 [ayvens.fr] INFO: Saving data for 1980813: {'created_time': 1774371052.735155, 'last_price_update_time': 1774371052.735166, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980813') HTTP/1.1" 204 0
2026-03-24 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:52 [ayvens.fr] INFO: Found listing with ID: 1980815
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980815%27 HTTP/1.1" 200 None
2026-03-24 16:50:52 [ayvens.fr] INFO: Scrape type for 1980815: 1
2026-03-24 16:50:52 [ayvens.fr] INFO: Extracting data for car ID: 1980815
2026-03-24 16:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 with identifier: 1980815
2026-03-24 16:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 with scrape type 1
2026-03-24 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/1.jpg not downloaded yet
2026-03-24 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/2.jpg not downloaded yet
2026-03-24 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce290>
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/1.jpg saved to cache
2026-03-24 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bcc90>
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/2.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/3.jpg not downloaded yet
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/4.jpg not downloaded yet
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8827dd0>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/4.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf0850>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/3.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d57ad0>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/5.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/5.jpg not downloaded yet
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/6.jpg not downloaded yet
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bcbad0>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/7.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/7.jpg not downloaded yet
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/8.jpg not downloaded yet
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5250>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/6.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [ayvens.fr] INFO: Found listing with ID: 1980816
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980816%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [ayvens.fr] INFO: Scrape type for 1980816: 1
2026-03-24 16:50:53 [ayvens.fr] INFO: Extracting data for car ID: 1980816
2026-03-24 16:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a7b417e-bc27-5229-a754-9d7a385c64da with identifier: 1980816
2026-03-24 16:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a7b417e-bc27-5229-a754-9d7a385c64da with scrape type 1
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/1.jpg not downloaded yet
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/2.jpg not downloaded yet
2026-03-24 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454eed0>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Ffa5fc18e19f843f2b3f02d2f69190c68%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/8.jpg saved to cache
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a161c93-fad4-543b-ab01-69a76b2660af
2026-03-24 16:50:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a161c93-fad4-543b-ab01-69a76b2660af, skipping ID generation
2026-03-24 16:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a161c93-fad4-543b-ab01-69a76b2660af with scrape type 1
2026-03-24 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a161c93-fad4-543b-ab01-69a76b2660af sending to next pipeline
2026-03-24 16:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0a161c93-fad4-543b-ab01-69a76b2660af, identifier: 1980814
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b612d0>
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/1.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5defed0>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/2.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/3.jpg not downloaded yet
2026-03-24 16:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0a161c93-fad4-543b-ab01-69a76b2660af with identifier: 1980814
2026-03-24 16:50:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0a161c93-fad4-543b-ab01-69a76b2660af with identifier: 1980814
2026-03-24 16:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0a161c93-fad4-543b-ab01-69a76b2660af with identifier: 1980814 to the API
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '0a161c93-fad4-543b-ab01-69a76b2660af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'STONIC',
'odometer': 7830,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426617,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426617,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a161c93-fad4-543b-ab01-69a76b2660af/0a161c93-fad4-543b-ab01-69a76b2660af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/fa5fc18e19f843f2b3f02d2f69190c68/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'KIA STONIC Stonic 1.0 T-GDi 100ch GT Line',
'transmission': 'manual',
'trim': 'Stonic 1.0 T-GDi 100ch GT Line',
'vin': None,
'year': 2024}
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980814%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [ayvens.fr] INFO: Saving data for 1980814: {'created_time': 1774371054.546488, 'last_price_update_time': 1774371054.5465, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980814') HTTP/1.1" 204 0
2026-03-24 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/4.jpg not downloaded yet
2026-03-24 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7edeb10>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/4.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cedc50>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/3.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/5.jpg not downloaded yet
2026-03-24 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/6.jpg not downloaded yet
2026-03-24 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d59750>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/6.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613cad0>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/7.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/7.jpg not downloaded yet
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/8.jpg not downloaded yet
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8a750>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/5.jpg saved to cache
2026-03-24 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fb710>
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fa489941990204629a810df83a4067639%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/8.jpg saved to cache
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223
2026-03-24 16:50:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223, skipping ID generation
2026-03-24 16:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 with scrape type 1
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 sending to next pipeline
2026-03-24 16:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223, identifier: 1980815
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79ffa90>
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/1.jpg saved to cache
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:55 [ayvens.fr] INFO: Found listing with ID: 1980817
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980817%27 HTTP/1.1" 200 None
2026-03-24 16:50:55 [ayvens.fr] INFO: Scrape type for 1980817: 1
2026-03-24 16:50:55 [ayvens.fr] INFO: Extracting data for car ID: 1980817
2026-03-24 16:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6af8c5c-18e4-5501-80cc-a96e2d4e256b with identifier: 1980817
2026-03-24 16:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b with scrape type 1
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/1.jpg not downloaded yet
2026-03-24 16:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 with identifier: 1980815
2026-03-24 16:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 with identifier: 1980815
2026-03-24 16:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223 with identifier: 1980815 to the API
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-2008',
'odometer': 34405,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249191,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223/5f2dd06f-a1c4-5ca3-a7d4-0fa852f44223_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/a489941990204629a810df83a4067639/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-2008 2008 e-2008 136ch Active Pack',
'transmission': 'automatic',
'trim': '2008 e-2008 136ch Active Pack',
'vin': None,
'year': 2023}
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980815%27 HTTP/1.1" 200 None
2026-03-24 16:50:55 [ayvens.fr] INFO: Saving data for 1980815: {'created_time': 1774371055.697157, 'last_price_update_time': 1774371055.69717, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980815') HTTP/1.1" 204 0
2026-03-24 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/2.jpg not downloaded yet
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d71b50>
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/3.jpg saved to cache
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/3.jpg not downloaded yet
2026-03-24 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/4.jpg not downloaded yet
2026-03-24 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56be110>
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/4.jpg saved to cache
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/5.jpg not downloaded yet
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/6.jpg not downloaded yet
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ceb5d0>
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/5.jpg saved to cache
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc8790>
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/2.jpg saved to cache
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6040750>
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/6.jpg saved to cache
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/7.jpg not downloaded yet
2026-03-24 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d01e10>
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/7.jpg saved to cache
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/8.jpg not downloaded yet
2026-03-24 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:56 [ayvens.fr] INFO: Found listing with ID: 1980818
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980818%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [ayvens.fr] INFO: Scrape type for 1980818: 1
2026-03-24 16:50:56 [ayvens.fr] INFO: Extracting data for car ID: 1980818
2026-03-24 16:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bda3b48-861a-5045-8a11-84ccd73feda7 with identifier: 1980818
2026-03-24 16:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bda3b48-861a-5045-8a11-84ccd73feda7 with scrape type 1
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/1.jpg not downloaded yet
2026-03-24 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/2.jpg not downloaded yet
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454ded0>
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa3e1bdbcdaac4b3cba4f5feadccdcebc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/8.jpg saved to cache
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a7b417e-bc27-5229-a754-9d7a385c64da
2026-03-24 16:50:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a7b417e-bc27-5229-a754-9d7a385c64da, skipping ID generation
2026-03-24 16:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a7b417e-bc27-5229-a754-9d7a385c64da with scrape type 1
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a7b417e-bc27-5229-a754-9d7a385c64da sending to next pipeline
2026-03-24 16:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6a7b417e-bc27-5229-a754-9d7a385c64da, identifier: 1980816
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/3.jpg not downloaded yet
2026-03-24 16:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6a7b417e-bc27-5229-a754-9d7a385c64da with identifier: 1980816
2026-03-24 16:50:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6a7b417e-bc27-5229-a754-9d7a385c64da with identifier: 1980816
2026-03-24 16:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6a7b417e-bc27-5229-a754-9d7a385c64da with identifier: 1980816 to the API
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS RAFALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '6a7b417e-bc27-5229-a754-9d7a385c64da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 86160,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a7b417e-bc27-5229-a754-9d7a385c64da/6a7b417e-bc27-5229-a754-9d7a385c64da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a3e1bdbcdaac4b3cba4f5feadccdcebc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 220ch Equilibre '
'optimum charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 220ch Equilibre optimum charge',
'vin': None,
'year': 2022}
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980816%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [ayvens.fr] INFO: Saving data for 1980816: {'created_time': 1774371057.116178, 'last_price_update_time': 1774371057.11619, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980816') HTTP/1.1" 204 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/4.jpg not downloaded yet
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61690>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/1.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3b90>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/4.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6a890>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/3.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1ee10>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/2.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/5.jpg not downloaded yet
2026-03-24 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/6.jpg not downloaded yet
2026-03-24 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/7.jpg not downloaded yet
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/8.jpg not downloaded yet
2026-03-24 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:57 [ayvens.fr] INFO: Found listing with ID: 1980819
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980819%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [ayvens.fr] INFO: Scrape type for 1980819: 1
2026-03-24 16:50:57 [ayvens.fr] INFO: Extracting data for car ID: 1980819
2026-03-24 16:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e051fb3-205e-5e76-9bc1-8636ffda58c8 with identifier: 1980819
2026-03-24 16:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8 with scrape type 1
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/1.jpg not downloaded yet
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/2.jpg not downloaded yet
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c54fd0>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/8.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc6650>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/6.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4575a10>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/5.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/3.jpg not downloaded yet
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b8510>
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F3110c8e20a4b4ad3bc23066a32a6d4dc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/7.jpg saved to cache
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b
2026-03-24 16:50:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6af8c5c-18e4-5501-80cc-a96e2d4e256b, skipping ID generation
2026-03-24 16:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b with scrape type 1
2026-03-24 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6af8c5c-18e4-5501-80cc-a96e2d4e256b sending to next pipeline
2026-03-24 16:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d6af8c5c-18e4-5501-80cc-a96e2d4e256b, identifier: 1980817
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1590>
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/1.jpg saved to cache
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/4.jpg not downloaded yet
2026-03-24 16:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d6af8c5c-18e4-5501-80cc-a96e2d4e256b with identifier: 1980817
2026-03-24 16:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d6af8c5c-18e4-5501-80cc-a96e2d4e256b with identifier: 1980817
2026-03-24 16:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d6af8c5c-18e4-5501-80cc-a96e2d4e256b with identifier: 1980817 to the API
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd6af8c5c-18e4-5501-80cc-a96e2d4e256b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 20114,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310551,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452036,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6af8c5c-18e4-5501-80cc-a96e2d4e256b/d6af8c5c-18e4-5501-80cc-a96e2d4e256b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/3110c8e20a4b4ad3bc23066a32a6d4dc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-22',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980817%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [ayvens.fr] INFO: Saving data for 1980817: {'created_time': 1774371058.509107, 'last_price_update_time': 1774371058.509119, 'auction_closing_time': 1774605600.0}
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980817') HTTP/1.1" 204 0
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c68110>
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/2.jpg saved to cache
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/5.jpg not downloaded yet
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/6.jpg not downloaded yet
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/7.jpg not downloaded yet
2026-03-24 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/8.jpg not downloaded yet
2026-03-24 16:50:58 [ayvens.fr] INFO: Found listing with ID: 1980820
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980820%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [ayvens.fr] INFO: Scrape type for 1980820: 1
2026-03-24 16:50:58 [ayvens.fr] INFO: Extracting data for car ID: 1980820
2026-03-24 16:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fb5e78-48d0-5db4-8c82-0e7379ce5402 with identifier: 1980820
2026-03-24 16:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402 with scrape type 1
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/1.jpg not downloaded yet
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/2.jpg not downloaded yet
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/3.jpg not downloaded yet
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e305d0>
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/3.jpg saved to cache
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/4.jpg not downloaded yet
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/5.jpg not downloaded yet
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc9c10>
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/8.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d13d90>
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/7.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6198210>
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/6.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60584d0>
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/5.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6051dd0>
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fbd3901ed9f174237a2bc62864ef87c05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/4.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bda3b48-861a-5045-8a11-84ccd73feda7
2026-03-24 16:50:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bda3b48-861a-5045-8a11-84ccd73feda7, skipping ID generation
2026-03-24 16:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bda3b48-861a-5045-8a11-84ccd73feda7 with scrape type 1
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bda3b48-861a-5045-8a11-84ccd73feda7 sending to next pipeline
2026-03-24 16:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2bda3b48-861a-5045-8a11-84ccd73feda7, identifier: 1980818
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4f350>
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/1.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da4210>
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/2.jpg saved to cache
2026-03-24 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2bda3b48-861a-5045-8a11-84ccd73feda7 with identifier: 1980818
2026-03-24 16:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2bda3b48-861a-5045-8a11-84ccd73feda7 with identifier: 1980818
2026-03-24 16:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2bda3b48-861a-5045-8a11-84ccd73feda7 with identifier: 1980818 to the API
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 207,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '2bda3b48-861a-5045-8a11-84ccd73feda7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 46213,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda3b48-861a-5045-8a11-84ccd73feda7/2bda3b48-861a-5045-8a11-84ccd73feda7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/bd3901ed9f174237a2bc62864ef87c05/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-15',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM Transit Custom Fg 280 L1H1 2.0 EcoBlue 130 S&S '
'Trend Business BVA6',
'transmission': 'automatic',
'trim': 'Transit Custom Fg 280 L1H1 2.0 EcoBlue 130 S&S Trend Business BVA6',
'vin': None,
'year': 2023}
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980818%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [ayvens.fr] INFO: Saving data for 1980818: {'created_time': 1774371060.021093, 'last_price_update_time': 1774371060.02111, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980818') HTTP/1.1" 204 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/6.jpg not downloaded yet
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/7.jpg not downloaded yet
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/8.jpg not downloaded yet
2026-03-24 16:51:00 [ayvens.fr] INFO: Found listing with ID: 1980821
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980821%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [ayvens.fr] INFO: Scrape type for 1980821: 1
2026-03-24 16:51:00 [ayvens.fr] INFO: Extracting data for car ID: 1980821
2026-03-24 16:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 with identifier: 1980821
2026-03-24 16:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 with scrape type 1
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/1.jpg not downloaded yet
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/2.jpg not downloaded yet
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/3.jpg not downloaded yet
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce2cd0>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/3.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/4.jpg not downloaded yet
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f1290>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/6.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79c7050>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/7.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/5.jpg not downloaded yet
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/6.jpg not downloaded yet
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fbb50>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/4.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7a350>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/5.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c71190>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe5f9372cb1334216a0968525c3b64e9e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/8.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8
2026-03-24 16:51:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e051fb3-205e-5e76-9bc1-8636ffda58c8, skipping ID generation
2026-03-24 16:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8 with scrape type 1
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e051fb3-205e-5e76-9bc1-8636ffda58c8 sending to next pipeline
2026-03-24 16:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0e051fb3-205e-5e76-9bc1-8636ffda58c8, identifier: 1980819
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d82d0>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/2.jpg saved to cache
2026-03-24 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60facd0>
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/1.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0e051fb3-205e-5e76-9bc1-8636ffda58c8 with identifier: 1980819
2026-03-24 16:51:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0e051fb3-205e-5e76-9bc1-8636ffda58c8 with identifier: 1980819
2026-03-24 16:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0e051fb3-205e-5e76-9bc1-8636ffda58c8 with identifier: 1980819 to the API
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'SKYSCRAPER GRAU METALISEE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '0e051fb3-205e-5e76-9bc1-8636ffda58c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 87311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e051fb3-205e-5e76-9bc1-8636ffda58c8/0e051fb3-205e-5e76-9bc1-8636ffda58c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e5f9372cb1334216a0968525c3b64e9e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Série 3 Touring 318iA 156ch Business Design',
'transmission': 'automatic',
'trim': 'Série 3 Touring 318iA 156ch Business Design',
'vin': None,
'year': 2023}
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980819%27 HTTP/1.1" 200 None
2026-03-24 16:51:01 [ayvens.fr] INFO: Saving data for 1980819: {'created_time': 1774371061.442712, 'last_price_update_time': 1774371061.442723, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980819') HTTP/1.1" 204 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/7.jpg not downloaded yet
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/8.jpg not downloaded yet
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b60d90>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/6.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7bd10>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/7.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:01 [ayvens.fr] INFO: Found listing with ID: 1980822
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980822%27 HTTP/1.1" 200 None
2026-03-24 16:51:01 [ayvens.fr] INFO: Scrape type for 1980822: 1
2026-03-24 16:51:01 [ayvens.fr] INFO: Extracting data for car ID: 1980822
2026-03-24 16:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea668074-a1d3-5eac-ab27-9473f5096c25 with identifier: 1980822
2026-03-24 16:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea668074-a1d3-5eac-ab27-9473f5096c25 with scrape type 1
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/1.jpg not downloaded yet
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/2.jpg not downloaded yet
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3a350>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/4.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf5410>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/5.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6052790>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/8.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc6910>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/1.jpg saved to cache
2026-03-24 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb6390>
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fb2356fe0858d4f09a3e41e292aaa0935%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/3.jpg saved to cache
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402
2026-03-24 16:51:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7fb5e78-48d0-5db4-8c82-0e7379ce5402, skipping ID generation
2026-03-24 16:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402 with scrape type 1
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7fb5e78-48d0-5db4-8c82-0e7379ce5402 sending to next pipeline
2026-03-24 16:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a7fb5e78-48d0-5db4-8c82-0e7379ce5402, identifier: 1980820
2026-03-24 16:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a7fb5e78-48d0-5db4-8c82-0e7379ce5402 with identifier: 1980820
2026-03-24 16:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a7fb5e78-48d0-5db4-8c82-0e7379ce5402 with identifier: 1980820
2026-03-24 16:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a7fb5e78-48d0-5db4-8c82-0e7379ce5402 with identifier: 1980820 to the API
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'a7fb5e78-48d0-5db4-8c82-0e7379ce5402',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 11278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351345,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fb5e78-48d0-5db4-8c82-0e7379ce5402/a7fb5e78-48d0-5db4-8c82-0e7379ce5402_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/b2356fe0858d4f09a3e41e292aaa0935/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance',
'vin': None,
'year': 2023}
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980820%27 HTTP/1.1" 200 None
2026-03-24 16:51:02 [ayvens.fr] INFO: Saving data for 1980820: {'created_time': 1774371062.454878, 'last_price_update_time': 1774371062.454889, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980820') HTTP/1.1" 204 0
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/3.jpg not downloaded yet
2026-03-24 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9150>
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/2.jpg saved to cache
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/4.jpg not downloaded yet
2026-03-24 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/5.jpg not downloaded yet
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621fa50>
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/5.jpg saved to cache
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/6.jpg not downloaded yet
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/7.jpg not downloaded yet
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d1750>
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/3.jpg saved to cache
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e38290>
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/4.jpg saved to cache
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457cb90>
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/6.jpg saved to cache
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cae790>
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/8.jpg saved to cache
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6126010>
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc9bb12aa2aec4755a768b3b333c994ed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/7.jpg saved to cache
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91
2026-03-24 16:51:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3acd0039-aac7-5cf0-9c9f-cb14b8922a91, skipping ID generation
2026-03-24 16:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 with scrape type 1
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 sending to next pipeline
2026-03-24 16:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3acd0039-aac7-5cf0-9c9f-cb14b8922a91, identifier: 1980821
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/8.jpg not downloaded yet
2026-03-24 16:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 with identifier: 1980821
2026-03-24 16:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 with identifier: 1980821
2026-03-24 16:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3acd0039-aac7-5cf0-9c9f-cb14b8922a91 with identifier: 1980821 to the API
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS NUIT',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.5L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '3acd0039-aac7-5cf0-9c9f-cb14b8922a91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 97855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3acd0039-aac7-5cf0-9c9f-cb14b8922a91/3acd0039-aac7-5cf0-9c9f-cb14b8922a91_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c9bb12aa2aec4755a768b3b333c994ed/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Long Range AWD',
'transmission': 'automatic',
'trim': 'Model Y Long Range AWD',
'vin': None,
'year': 2022}
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980821%27 HTTP/1.1" 200 None
2026-03-24 16:51:03 [ayvens.fr] INFO: Saving data for 1980821: {'created_time': 1774371063.942027, 'last_price_update_time': 1774371063.942038, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980821') HTTP/1.1" 204 0
2026-03-24 16:51:03 [ayvens.fr] INFO: Found listing with ID: 1980823
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980823%27 HTTP/1.1" 200 None
2026-03-24 16:51:03 [ayvens.fr] INFO: Scrape type for 1980823: 1
2026-03-24 16:51:03 [ayvens.fr] INFO: Extracting data for car ID: 1980823
2026-03-24 16:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea3a10e-4262-53f1-ae37-2473cb2c679c with identifier: 1980823
2026-03-24 16:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c with scrape type 1
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/1.jpg not downloaded yet
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/2.jpg not downloaded yet
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/3.jpg not downloaded yet
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/4.jpg not downloaded yet
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/5.jpg not downloaded yet
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/6.jpg not downloaded yet
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/7.jpg not downloaded yet
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/8.jpg not downloaded yet
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [ayvens.fr] INFO: Found listing with ID: 1980824
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980824%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [ayvens.fr] INFO: Scrape type for 1980824: 1
2026-03-24 16:51:04 [ayvens.fr] INFO: Extracting data for car ID: 1980824
2026-03-24 16:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 with identifier: 1980824
2026-03-24 16:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 with scrape type 1
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/1.jpg not downloaded yet
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0250>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/1.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c689d0>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/2.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/2.jpg not downloaded yet
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45ba710>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/3.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5c110>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/4.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def3d0>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/5.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629e7d0>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/6.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/3.jpg not downloaded yet
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff190>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/7.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/4.jpg not downloaded yet
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/5.jpg not downloaded yet
2026-03-24 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/6.jpg not downloaded yet
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c613d0>
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3cc314a8dbf14ea7bc5e499b15205cf7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/8.jpg saved to cache
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea668074-a1d3-5eac-ab27-9473f5096c25
2026-03-24 16:51:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea668074-a1d3-5eac-ab27-9473f5096c25, skipping ID generation
2026-03-24 16:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea668074-a1d3-5eac-ab27-9473f5096c25 with scrape type 1
2026-03-24 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea668074-a1d3-5eac-ab27-9473f5096c25 sending to next pipeline
2026-03-24 16:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ea668074-a1d3-5eac-ab27-9473f5096c25, identifier: 1980822
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8214750>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/1.jpg saved to cache
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/7.jpg not downloaded yet
2026-03-24 16:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ea668074-a1d3-5eac-ab27-9473f5096c25 with identifier: 1980822
2026-03-24 16:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ea668074-a1d3-5eac-ab27-9473f5096c25 with identifier: 1980822
2026-03-24 16:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ea668074-a1d3-5eac-ab27-9473f5096c25 with identifier: 1980822 to the API
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'ea668074-a1d3-5eac-ab27-9473f5096c25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 24803,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481551,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481551,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302339,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea668074-a1d3-5eac-ab27-9473f5096c25/ea668074-a1d3-5eac-ab27-9473f5096c25_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3cc314a8dbf14ea7bc5e499b15205cf7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980822%27 HTTP/1.1" 200 None
2026-03-24 16:51:05 [ayvens.fr] INFO: Saving data for 1980822: {'created_time': 1774371065.472111, 'last_price_update_time': 1774371065.472122, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980822') HTTP/1.1" 204 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/8.jpg not downloaded yet
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce9250>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/6.jpg saved to cache
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0ad0>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/3.jpg saved to cache
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4577710>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/2.jpg saved to cache
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e457e8d0>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/5.jpg saved to cache
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4575a10>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/4.jpg saved to cache
2026-03-24 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1fc10>
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/7.jpg saved to cache
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:06 [ayvens.fr] INFO: Found listing with ID: 1980825
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980825%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [ayvens.fr] INFO: Scrape type for 1980825: 1
2026-03-24 16:51:06 [ayvens.fr] INFO: Extracting data for car ID: 1980825
2026-03-24 16:51:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bbc32dd-9a43-5b8b-844c-a4400e60cddf with identifier: 1980825
2026-03-24 16:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf with scrape type 1
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/1.jpg not downloaded yet
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/2.jpg not downloaded yet
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/3.jpg not downloaded yet
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/4.jpg not downloaded yet
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/5.jpg not downloaded yet
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/6.jpg not downloaded yet
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/7.jpg not downloaded yet
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/8.jpg not downloaded yet
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c8ab90>
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F458976bd670643a6891a7b08ee682100%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/8.jpg saved to cache
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c
2026-03-24 16:51:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ea3a10e-4262-53f1-ae37-2473cb2c679c, skipping ID generation
2026-03-24 16:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c with scrape type 1
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ea3a10e-4262-53f1-ae37-2473cb2c679c sending to next pipeline
2026-03-24 16:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2ea3a10e-4262-53f1-ae37-2473cb2c679c, identifier: 1980823
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0290>
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/1.jpg saved to cache
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a3890>
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/2.jpg saved to cache
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3050>
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/3.jpg saved to cache
2026-03-24 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fb490>
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/4.jpg saved to cache
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 2 pages/min), scraped 214 items (at 37 items/min)
2026-03-24 16:51:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:51:07 [ayvens.fr] INFO: Found listing with ID: 1980826
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980826%27 HTTP/1.1" 200 None
2026-03-24 16:51:07 [ayvens.fr] INFO: Scrape type for 1980826: 1
2026-03-24 16:51:07 [ayvens.fr] INFO: Extracting data for car ID: 1980826
2026-03-24 16:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 with identifier: 1980826
2026-03-24 16:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 with scrape type 1
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/1.jpg not downloaded yet
2026-03-24 16:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2ea3a10e-4262-53f1-ae37-2473cb2c679c with identifier: 1980823
2026-03-24 16:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2ea3a10e-4262-53f1-ae37-2473cb2c679c with identifier: 1980823
2026-03-24 16:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2ea3a10e-4262-53f1-ae37-2473cb2c679c with identifier: 1980823 to the API
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '2ea3a10e-4262-53f1-ae37-2473cb2c679c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 89789,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea3a10e-4262-53f1-ae37-2473cb2c679c/2ea3a10e-4262-53f1-ae37-2473cb2c679c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/458976bd670643a6891a7b08ee682100/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-18',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 80ch Extra '
'R-Link',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 80ch Extra R-Link',
'vin': None,
'year': 2021}
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980823%27 HTTP/1.1" 200 None
2026-03-24 16:51:07 [ayvens.fr] INFO: Saving data for 1980823: {'created_time': 1774371067.555856, 'last_price_update_time': 1774371067.555867, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980823') HTTP/1.1" 204 0
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf2b90>
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/6.jpg saved to cache
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/2.jpg not downloaded yet
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7f410>
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/5.jpg saved to cache
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617e590>
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/7.jpg saved to cache
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/3.jpg not downloaded yet
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f33d0>
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9d6479c242d54adeb33f644c08ebfaa4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/8.jpg saved to cache
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9
2026-03-24 16:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4df16d47-09e7-5bb0-91c9-c95de5d08ad9, skipping ID generation
2026-03-24 16:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 with scrape type 1
2026-03-24 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 sending to next pipeline
2026-03-24 16:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4df16d47-09e7-5bb0-91c9-c95de5d08ad9, identifier: 1980824
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 with identifier: 1980824
2026-03-24 16:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 with identifier: 1980824
2026-03-24 16:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4df16d47-09e7-5bb0-91c9-c95de5d08ad9 with identifier: 1980824 to the API
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '4df16d47-09e7-5bb0-91c9-c95de5d08ad9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 109692,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df16d47-09e7-5bb0-91c9-c95de5d08ad9/4df16d47-09e7-5bb0-91c9-c95de5d08ad9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330212,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9d6479c242d54adeb33f644c08ebfaa4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'vin': None,
'year': 2022}
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980824%27 HTTP/1.1" 200 None
2026-03-24 16:51:08 [ayvens.fr] INFO: Saving data for 1980824: {'created_time': 1774371068.642046, 'last_price_update_time': 1774371068.642058, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980824') HTTP/1.1" 204 0
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/4.jpg not downloaded yet
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/5.jpg not downloaded yet
2026-03-24 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c62310>
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/5.jpg saved to cache
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/6.jpg not downloaded yet
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/7.jpg not downloaded yet
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6146550>
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/6.jpg saved to cache
2026-03-24 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cea690>
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/4.jpg saved to cache
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b74390>
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/2.jpg saved to cache
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77350>
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/3.jpg saved to cache
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb7dd0>
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/1.jpg saved to cache
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc3890>
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/7.jpg saved to cache
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/8.jpg not downloaded yet
2026-03-24 16:51:09 [ayvens.fr] INFO: Found listing with ID: 1980827
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980827%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [ayvens.fr] INFO: Scrape type for 1980827: 1
2026-03-24 16:51:09 [ayvens.fr] INFO: Extracting data for car ID: 1980827
2026-03-24 16:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ddc2a0-4a94-5809-85a8-504d045cb5f6 with identifier: 1980827
2026-03-24 16:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6 with scrape type 1
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/1.jpg not downloaded yet
2026-03-24 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/2.jpg not downloaded yet
2026-03-24 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/3.jpg not downloaded yet
2026-03-24 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/4.jpg not downloaded yet
2026-03-24 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/5.jpg not downloaded yet
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d1c50>
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F3d26344f17ac47f2ac17f71b09b9f13b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/8.jpg saved to cache
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf
2026-03-24 16:51:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bbc32dd-9a43-5b8b-844c-a4400e60cddf, skipping ID generation
2026-03-24 16:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf with scrape type 1
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bbc32dd-9a43-5b8b-844c-a4400e60cddf sending to next pipeline
2026-03-24 16:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3bbc32dd-9a43-5b8b-844c-a4400e60cddf, identifier: 1980825
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/6.jpg not downloaded yet
2026-03-24 16:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3bbc32dd-9a43-5b8b-844c-a4400e60cddf with identifier: 1980825
2026-03-24 16:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3bbc32dd-9a43-5b8b-844c-a4400e60cddf with identifier: 1980825
2026-03-24 16:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3bbc32dd-9a43-5b8b-844c-a4400e60cddf with identifier: 1980825 to the API
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'BLANC BANQUISE OPAQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '3bbc32dd-9a43-5b8b-844c-a4400e60cddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPER',
'odometer': 111223,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bbc32dd-9a43-5b8b-844c-a4400e60cddf/3bbc32dd-9a43-5b8b-844c-a4400e60cddf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/3d26344f17ac47f2ac17f71b09b9f13b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-06',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPER Jumper Fg 30 L1H1 2.0 BlueHDi 110 Business',
'transmission': 'manual',
'trim': 'Jumper Fg 30 L1H1 2.0 BlueHDi 110 Business',
'vin': None,
'year': 2019}
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980825%27 HTTP/1.1" 200 None
2026-03-24 16:51:09 [ayvens.fr] INFO: Saving data for 1980825: {'created_time': 1774371069.955078, 'last_price_update_time': 1774371069.955093, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980825') HTTP/1.1" 204 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/7.jpg not downloaded yet
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/8.jpg not downloaded yet
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6b250>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/3.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf36d0>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/1.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6050750>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/2.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0550>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/4.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dee6d0>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/5.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [ayvens.fr] INFO: Found listing with ID: 1980828
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980828%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [ayvens.fr] INFO: Scrape type for 1980828: 1
2026-03-24 16:51:10 [ayvens.fr] INFO: Extracting data for car ID: 1980828
2026-03-24 16:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd35361d-de3e-56a3-8188-b146e94b4276 with identifier: 1980828
2026-03-24 16:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd35361d-de3e-56a3-8188-b146e94b4276 with scrape type 1
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/1.jpg not downloaded yet
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/2.jpg not downloaded yet
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf1c90>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/6.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/3.jpg not downloaded yet
2026-03-24 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/4.jpg not downloaded yet
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c89e50>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/2.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053c50>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/1.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bd750>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/7.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56a6090>
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252F4ab351694a55489690729dc35862e7b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/8.jpg saved to cache
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3
2026-03-24 16:51:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5eb2e902-b660-5fdb-9b85-b1ef886c80b3, skipping ID generation
2026-03-24 16:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 with scrape type 1
2026-03-24 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 sending to next pipeline
2026-03-24 16:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5eb2e902-b660-5fdb-9b85-b1ef886c80b3, identifier: 1980826
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba0dd0>
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/3.jpg saved to cache
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621df10>
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/4.jpg saved to cache
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/5.jpg not downloaded yet
2026-03-24 16:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 with identifier: 1980826
2026-03-24 16:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 with identifier: 1980826
2026-03-24 16:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5eb2e902-b660-5fdb-9b85-b1ef886c80b3 with identifier: 1980826 to the API
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 170,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '5eb2e902-b660-5fdb-9b85-b1ef886c80b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 119478,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eb2e902-b660-5fdb-9b85-b1ef886c80b3/5eb2e902-b660-5fdb-9b85-b1ef886c80b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/4ab351694a55489690729dc35862e7b5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L1H1 1000 1.6 dCi 95ch Grand Confort Euro6',
'transmission': 'manual',
'trim': 'Trafic Fg L1H1 1000 1.6 dCi 95ch Grand Confort Euro6',
'vin': None,
'year': 2018}
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980826%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [ayvens.fr] INFO: Saving data for 1980826: {'created_time': 1774371071.616693, 'last_price_update_time': 1774371071.616707, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980826') HTTP/1.1" 204 0
2026-03-24 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83b90>
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/5.jpg saved to cache
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/6.jpg not downloaded yet
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0d50>
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/6.jpg saved to cache
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/7.jpg not downloaded yet
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6100810>
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/8.jpg saved to cache
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/8.jpg not downloaded yet
2026-03-24 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:11 [ayvens.fr] INFO: Found listing with ID: 1980829
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980829%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [ayvens.fr] INFO: Scrape type for 1980829: 1
2026-03-24 16:51:11 [ayvens.fr] INFO: Extracting data for car ID: 1980829
2026-03-24 16:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 026567e8-d705-51f6-ace3-c7b77607d3bb with identifier: 1980829
2026-03-24 16:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026567e8-d705-51f6-ace3-c7b77607d3bb with scrape type 1
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/1.jpg not downloaded yet
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/2.jpg not downloaded yet
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b54750>
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F33b331e3a62b46c7b92b231932bfeee6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/7.jpg saved to cache
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6
2026-03-24 16:51:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73ddc2a0-4a94-5809-85a8-504d045cb5f6, skipping ID generation
2026-03-24 16:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6 with scrape type 1
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73ddc2a0-4a94-5809-85a8-504d045cb5f6 sending to next pipeline
2026-03-24 16:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 73ddc2a0-4a94-5809-85a8-504d045cb5f6, identifier: 1980827
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/3.jpg not downloaded yet
2026-03-24 16:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 73ddc2a0-4a94-5809-85a8-504d045cb5f6 with identifier: 1980827
2026-03-24 16:51:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 73ddc2a0-4a94-5809-85a8-504d045cb5f6 with identifier: 1980827
2026-03-24 16:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 73ddc2a0-4a94-5809-85a8-504d045cb5f6 with identifier: 1980827 to the API
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 30,
'color': 'NOIR INTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '73ddc2a0-4a94-5809-85a8-504d045cb5f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'ARTEON',
'odometer': 91878,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ddc2a0-4a94-5809-85a8-504d045cb5f6/73ddc2a0-4a94-5809-85a8-504d045cb5f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/33b331e3a62b46c7b92b231932bfeee6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN ARTEON Arteon 1.4 TSI eHybrid OPF 218ch R-Line DSG6',
'transmission': 'automatic',
'trim': 'Arteon 1.4 TSI eHybrid OPF 218ch R-Line DSG6',
'vin': None,
'year': 2022}
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980827%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [ayvens.fr] INFO: Saving data for 1980827: {'created_time': 1774371072.590979, 'last_price_update_time': 1774371072.590991, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980827') HTTP/1.1" 204 0
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/4.jpg not downloaded yet
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce9210>
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/1.jpg saved to cache
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b54050>
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/2.jpg saved to cache
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e890>
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/3.jpg saved to cache
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/5.jpg not downloaded yet
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/6.jpg not downloaded yet
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a350>
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/5.jpg saved to cache
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/7.jpg not downloaded yet
2026-03-24 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/8.jpg not downloaded yet
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e33d10>
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/7.jpg saved to cache
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3b510>
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/6.jpg saved to cache
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:13 [ayvens.fr] INFO: Found listing with ID: 1980830
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980830%27 HTTP/1.1" 200 None
2026-03-24 16:51:13 [ayvens.fr] INFO: Scrape type for 1980830: 1
2026-03-24 16:51:13 [ayvens.fr] INFO: Extracting data for car ID: 1980830
2026-03-24 16:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60fda560-0f5c-57d0-bb02-e7a5638a59b8 with identifier: 1980830
2026-03-24 16:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8 with scrape type 1
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/1.jpg not downloaded yet
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc2ad0>
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/4.jpg saved to cache
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b74850>
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/1.jpg saved to cache
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/2.jpg not downloaded yet
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5709b50>
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3b61f893539043059462b1c27328e477%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/8.jpg saved to cache
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd35361d-de3e-56a3-8188-b146e94b4276
2026-03-24 16:51:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd35361d-de3e-56a3-8188-b146e94b4276, skipping ID generation
2026-03-24 16:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd35361d-de3e-56a3-8188-b146e94b4276 with scrape type 1
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd35361d-de3e-56a3-8188-b146e94b4276 sending to next pipeline
2026-03-24 16:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cd35361d-de3e-56a3-8188-b146e94b4276, identifier: 1980828
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617e590>
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/2.jpg saved to cache
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/3.jpg not downloaded yet
2026-03-24 16:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cd35361d-de3e-56a3-8188-b146e94b4276 with identifier: 1980828
2026-03-24 16:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cd35361d-de3e-56a3-8188-b146e94b4276 with identifier: 1980828
2026-03-24 16:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cd35361d-de3e-56a3-8188-b146e94b4276 with identifier: 1980828 to the API
2026-03-24 16:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'cd35361d-de3e-56a3-8188-b146e94b4276',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 78125,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd35361d-de3e-56a3-8188-b146e94b4276/cd35361d-de3e-56a3-8188-b146e94b4276_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3b61f893539043059462b1c27328e477/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980828%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [ayvens.fr] INFO: Saving data for 1980828: {'created_time': 1774371074.549889, 'last_price_update_time': 1774371074.549905, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980828') HTTP/1.1" 204 0
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/4.jpg not downloaded yet
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/5.jpg not downloaded yet
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/6.jpg not downloaded yet
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/7.jpg not downloaded yet
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/8.jpg not downloaded yet
2026-03-24 16:51:14 [ayvens.fr] INFO: Found listing with ID: 1980831
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980831%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [ayvens.fr] INFO: Scrape type for 1980831: 1
2026-03-24 16:51:14 [ayvens.fr] INFO: Extracting data for car ID: 1980831
2026-03-24 16:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60693f96-33ae-58c2-8c69-1d898cd87271 with identifier: 1980831
2026-03-24 16:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60693f96-33ae-58c2-8c69-1d898cd87271 with scrape type 1
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/1.jpg not downloaded yet
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75c50>
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/3.jpg saved to cache
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5110>
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/6.jpg saved to cache
2026-03-24 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a2a90>
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/7.jpg saved to cache
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60430d0>
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/5.jpg saved to cache
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6b550>
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/4.jpg saved to cache
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/2.jpg not downloaded yet
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7e04690>
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F8dd9a921b2534e0fb8da852ca4154aac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/8.jpg saved to cache
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 026567e8-d705-51f6-ace3-c7b77607d3bb
2026-03-24 16:51:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 026567e8-d705-51f6-ace3-c7b77607d3bb, skipping ID generation
2026-03-24 16:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026567e8-d705-51f6-ace3-c7b77607d3bb with scrape type 1
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 026567e8-d705-51f6-ace3-c7b77607d3bb sending to next pipeline
2026-03-24 16:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 026567e8-d705-51f6-ace3-c7b77607d3bb, identifier: 1980829
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba2bd0>
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/1.jpg saved to cache
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/3.jpg not downloaded yet
2026-03-24 16:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 026567e8-d705-51f6-ace3-c7b77607d3bb with identifier: 1980829
2026-03-24 16:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 026567e8-d705-51f6-ace3-c7b77607d3bb with identifier: 1980829
2026-03-24 16:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 026567e8-d705-51f6-ace3-c7b77607d3bb with identifier: 1980829 to the API
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '026567e8-d705-51f6-ace3-c7b77607d3bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'EV6',
'odometer': 78242,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283692,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026567e8-d705-51f6-ace3-c7b77607d3bb/026567e8-d705-51f6-ace3-c7b77607d3bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/8dd9a921b2534e0fb8da852ca4154aac/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'KIA EV6 EV6 325ch GT-Line Business 4WD',
'transmission': 'automatic',
'trim': 'EV6 325ch GT-Line Business 4WD',
'vin': None,
'year': 2024}
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980829%27 HTTP/1.1" 200 None
2026-03-24 16:51:15 [ayvens.fr] INFO: Saving data for 1980829: {'created_time': 1774371075.88858, 'last_price_update_time': 1774371075.888592, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980829') HTTP/1.1" 204 0
2026-03-24 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/4.jpg not downloaded yet
2026-03-24 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629c290>
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/4.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/5.jpg not downloaded yet
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/6.jpg not downloaded yet
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a0b10>
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/2.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cea8d0>
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/3.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5ded0>
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/5.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8a90>
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/6.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e30150>
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/7.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/7.jpg not downloaded yet
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/8.jpg not downloaded yet
2026-03-24 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:16 [ayvens.fr] INFO: Found listing with ID: 1980832
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980832%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [ayvens.fr] INFO: Scrape type for 1980832: 1
2026-03-24 16:51:16 [ayvens.fr] INFO: Extracting data for car ID: 1980832
2026-03-24 16:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c44c6a-c2f9-5b84-b04f-392b13d8d58f with identifier: 1980832
2026-03-24 16:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f with scrape type 1
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/1.jpg not downloaded yet
2026-03-24 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/2.jpg not downloaded yet
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/3.jpg not downloaded yet
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4df50>
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F74e52fd49800434c8d006dbbb6022bcc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/8.jpg saved to cache
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8
2026-03-24 16:51:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60fda560-0f5c-57d0-bb02-e7a5638a59b8, skipping ID generation
2026-03-24 16:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8 with scrape type 1
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60fda560-0f5c-57d0-bb02-e7a5638a59b8 sending to next pipeline
2026-03-24 16:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 60fda560-0f5c-57d0-bb02-e7a5638a59b8, identifier: 1980830
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/4.jpg not downloaded yet
2026-03-24 16:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 60fda560-0f5c-57d0-bb02-e7a5638a59b8 with identifier: 1980830
2026-03-24 16:51:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 60fda560-0f5c-57d0-bb02-e7a5638a59b8 with identifier: 1980830
2026-03-24 16:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 60fda560-0f5c-57d0-bb02-e7a5638a59b8 with identifier: 1980830 to the API
2026-03-24 16:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 28,
'color': 'SAPHIRSCHWARTZ METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.4L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '60fda560-0f5c-57d0-bb02-e7a5638a59b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X5',
'odometer': 115726,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60fda560-0f5c-57d0-bb02-e7a5638a59b8/60fda560-0f5c-57d0-bb02-e7a5638a59b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/74e52fd49800434c8d006dbbb6022bcc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 X5 xDrive45e 394ch xLine',
'transmission': 'automatic',
'trim': 'X5 xDrive45e 394ch xLine',
'vin': None,
'year': 2021}
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980830%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [ayvens.fr] INFO: Saving data for 1980830: {'created_time': 1774371077.486258, 'last_price_update_time': 1774371077.486269, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980830') HTTP/1.1" 204 0
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/5.jpg not downloaded yet
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6aa50>
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/1.jpg saved to cache
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ecd0>
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/2.jpg saved to cache
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b4810>
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/3.jpg saved to cache
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621ddd0>
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/4.jpg saved to cache
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/6.jpg not downloaded yet
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/7.jpg not downloaded yet
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/8.jpg not downloaded yet
2026-03-24 16:51:17 [ayvens.fr] INFO: Found listing with ID: 1980833
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980833%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [ayvens.fr] INFO: Scrape type for 1980833: 1
2026-03-24 16:51:17 [ayvens.fr] INFO: Extracting data for car ID: 1980833
2026-03-24 16:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78593c15-3306-55a3-a7a7-b86352f240ff with identifier: 1980833
2026-03-24 16:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78593c15-3306-55a3-a7a7-b86352f240ff with scrape type 1
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/1.jpg not downloaded yet
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/2.jpg not downloaded yet
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/3.jpg not downloaded yet
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/4.jpg not downloaded yet
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8fd0>
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/5.jpg saved to cache
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6ba50>
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/6.jpg saved to cache
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b2f90>
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/8.jpg saved to cache
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1550>
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F15bf6d047c3e4bc49c61a813366ec40d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/7.jpg saved to cache
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60693f96-33ae-58c2-8c69-1d898cd87271
2026-03-24 16:51:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60693f96-33ae-58c2-8c69-1d898cd87271, skipping ID generation
2026-03-24 16:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60693f96-33ae-58c2-8c69-1d898cd87271 with scrape type 1
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60693f96-33ae-58c2-8c69-1d898cd87271 sending to next pipeline
2026-03-24 16:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 60693f96-33ae-58c2-8c69-1d898cd87271, identifier: 1980831
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/5.jpg not downloaded yet
2026-03-24 16:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 60693f96-33ae-58c2-8c69-1d898cd87271 with identifier: 1980831
2026-03-24 16:51:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 60693f96-33ae-58c2-8c69-1d898cd87271 with identifier: 1980831
2026-03-24 16:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 60693f96-33ae-58c2-8c69-1d898cd87271 with identifier: 1980831 to the API
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'GRIS PYRITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '60693f96-33ae-58c2-8c69-1d898cd87271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'T-ROC',
'odometer': 26206,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60693f96-33ae-58c2-8c69-1d898cd87271/60693f96-33ae-58c2-8c69-1d898cd87271_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/15bf6d047c3e4bc49c61a813366ec40d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN T-ROC T-Roc 1.0 TSI 110ch Life Plus',
'transmission': 'manual',
'trim': 'T-Roc 1.0 TSI 110ch Life Plus',
'vin': None,
'year': 2023}
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980831%27 HTTP/1.1" 200 None
2026-03-24 16:51:18 [ayvens.fr] INFO: Saving data for 1980831: {'created_time': 1774371078.770926, 'last_price_update_time': 1774371078.77094, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980831') HTTP/1.1" 204 0
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/6.jpg not downloaded yet
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcea10>
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/1.jpg saved to cache
2026-03-24 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459c2d0>
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/3.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a0610>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/2.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/7.jpg not downloaded yet
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/8.jpg not downloaded yet
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [ayvens.fr] INFO: Found listing with ID: 1980834
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980834%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [ayvens.fr] INFO: Scrape type for 1980834: 1
2026-03-24 16:51:19 [ayvens.fr] INFO: Extracting data for car ID: 1980834
2026-03-24 16:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef28fcf-01fb-5407-81c9-6d15c51f31bb with identifier: 1980834
2026-03-24 16:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb with scrape type 1
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/1.jpg not downloaded yet
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/2.jpg not downloaded yet
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/3.jpg not downloaded yet
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/4.jpg not downloaded yet
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfb490>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/6.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/5.jpg not downloaded yet
2026-03-24 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/6.jpg not downloaded yet
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/7.jpg not downloaded yet
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a98d0>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/4.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bd3410>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/5.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61991d0>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/7.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dc19d0>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/2.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0ee10>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F282443da03b94e99a9e72b9d24d31d9b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/8.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f
2026-03-24 16:51:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27c44c6a-c2f9-5b84-b04f-392b13d8d58f, skipping ID generation
2026-03-24 16:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f with scrape type 1
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27c44c6a-c2f9-5b84-b04f-392b13d8d58f sending to next pipeline
2026-03-24 16:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 27c44c6a-c2f9-5b84-b04f-392b13d8d58f, identifier: 1980832
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bac050>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/1.jpg saved to cache
2026-03-24 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcf990>
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/3.jpg saved to cache
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 27c44c6a-c2f9-5b84-b04f-392b13d8d58f with identifier: 1980832
2026-03-24 16:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 27c44c6a-c2f9-5b84-b04f-392b13d8d58f with identifier: 1980832
2026-03-24 16:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 27c44c6a-c2f9-5b84-b04f-392b13d8d58f with identifier: 1980832 to the API
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '27c44c6a-c2f9-5b84-b04f-392b13d8d58f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CONNECT VU',
'odometer': 75854,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c44c6a-c2f9-5b84-b04f-392b13d8d58f/27c44c6a-c2f9-5b84-b04f-392b13d8d58f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/282443da03b94e99a9e72b9d24d31d9b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-26',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CONNECT VU Transit Connect L1 1.5 EcoBlue 75ch Trend '
'Business Nav',
'transmission': 'manual',
'trim': 'Transit Connect L1 1.5 EcoBlue 75ch Trend Business Nav',
'vin': None,
'year': 2020}
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980832%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [ayvens.fr] INFO: Saving data for 1980832: {'created_time': 1774371080.439508, 'last_price_update_time': 1774371080.439523, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980832') HTTP/1.1" 204 0
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/8.jpg not downloaded yet
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [ayvens.fr] INFO: Found listing with ID: 1980835
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980835%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [ayvens.fr] INFO: Scrape type for 1980835: 1
2026-03-24 16:51:20 [ayvens.fr] INFO: Extracting data for car ID: 1980835
2026-03-24 16:51:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e58c0f-5804-50ae-b565-64a88beff1cd with identifier: 1980835
2026-03-24 16:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e58c0f-5804-50ae-b565-64a88beff1cd with scrape type 1
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/1.jpg not downloaded yet
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dc1650>
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/4.jpg saved to cache
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/2.jpg not downloaded yet
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/3.jpg not downloaded yet
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e63657d0>
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/5.jpg saved to cache
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fff50>
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/8.jpg saved to cache
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/4.jpg not downloaded yet
2026-03-24 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/5.jpg not downloaded yet
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e650>
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/1.jpg saved to cache
2026-03-24 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b691d0>
2026-03-24 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/6.jpg saved to cache
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc2650>
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/4.jpg saved to cache
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621e310>
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F8d8f831586f442f4bb6c464b9ec4f768%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/7.jpg saved to cache
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78593c15-3306-55a3-a7a7-b86352f240ff
2026-03-24 16:51:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78593c15-3306-55a3-a7a7-b86352f240ff, skipping ID generation
2026-03-24 16:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78593c15-3306-55a3-a7a7-b86352f240ff with scrape type 1
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78593c15-3306-55a3-a7a7-b86352f240ff sending to next pipeline
2026-03-24 16:51:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 78593c15-3306-55a3-a7a7-b86352f240ff, identifier: 1980833
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6144210>
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/3.jpg saved to cache
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/6.jpg not downloaded yet
2026-03-24 16:51:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 78593c15-3306-55a3-a7a7-b86352f240ff with identifier: 1980833
2026-03-24 16:51:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 78593c15-3306-55a3-a7a7-b86352f240ff with identifier: 1980833
2026-03-24 16:51:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 78593c15-3306-55a3-a7a7-b86352f240ff with identifier: 1980833 to the API
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '78593c15-3306-55a3-a7a7-b86352f240ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'AURIS HSD',
'odometer': 99400,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78593c15-3306-55a3-a7a7-b86352f240ff/78593c15-3306-55a3-a7a7-b86352f240ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/8d8f831586f442f4bb6c464b9ec4f768/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA AURIS HSD Auris HSD 136h Collection',
'transmission': 'automatic',
'trim': 'Auris HSD 136h Collection',
'vin': None,
'year': 2019}
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980833%27 HTTP/1.1" 200 None
2026-03-24 16:51:21 [ayvens.fr] INFO: Saving data for 1980833: {'created_time': 1774371081.82783, 'last_price_update_time': 1774371081.827842, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980833') HTTP/1.1" 204 0
2026-03-24 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/7.jpg not downloaded yet
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b2e50>
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/2.jpg saved to cache
2026-03-24 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7e410>
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/5.jpg saved to cache
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddcf50>
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/7.jpg saved to cache
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/8.jpg not downloaded yet
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba2b50>
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/6.jpg saved to cache
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:22 [ayvens.fr] INFO: Found listing with ID: 1980836
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980836%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [ayvens.fr] INFO: Scrape type for 1980836: 1
2026-03-24 16:51:22 [ayvens.fr] INFO: Extracting data for car ID: 1980836
2026-03-24 16:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66c2496-53bf-5691-b406-0d03da923b3a with identifier: 1980836
2026-03-24 16:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66c2496-53bf-5691-b406-0d03da923b3a with scrape type 1
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/1.jpg not downloaded yet
2026-03-24 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/2.jpg not downloaded yet
2026-03-24 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b7550>
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/1.jpg saved to cache
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7db19d0>
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff9ec1fa2f9b745e2830952c3d3fd32ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/8.jpg saved to cache
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb
2026-03-24 16:51:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ef28fcf-01fb-5407-81c9-6d15c51f31bb, skipping ID generation
2026-03-24 16:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb with scrape type 1
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ef28fcf-01fb-5407-81c9-6d15c51f31bb sending to next pipeline
2026-03-24 16:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5ef28fcf-01fb-5407-81c9-6d15c51f31bb, identifier: 1980834
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/3.jpg not downloaded yet
2026-03-24 16:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5ef28fcf-01fb-5407-81c9-6d15c51f31bb with identifier: 1980834
2026-03-24 16:51:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5ef28fcf-01fb-5407-81c9-6d15c51f31bb with identifier: 1980834
2026-03-24 16:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5ef28fcf-01fb-5407-81c9-6d15c51f31bb with identifier: 1980834 to the API
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'SAPHIRSCHWARZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '5ef28fcf-01fb-5407-81c9-6d15c51f31bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 66365,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef28fcf-01fb-5407-81c9-6d15c51f31bb/5ef28fcf-01fb-5407-81c9-6d15c51f31bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f9ec1fa2f9b745e2830952c3d3fd32ca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Série 1 118iA 136ch Edition Sport DKG7',
'transmission': 'automatic',
'trim': 'Série 1 118iA 136ch Edition Sport DKG7',
'vin': None,
'year': 2023}
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980834%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [ayvens.fr] INFO: Saving data for 1980834: {'created_time': 1774371082.9331, 'last_price_update_time': 1774371082.933111, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980834') HTTP/1.1" 204 0
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/4.jpg not downloaded yet
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6095610>
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/2.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cebd10>
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/3.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fb9d0>
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/5.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5def350>
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/4.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/5.jpg not downloaded yet
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/6.jpg not downloaded yet
2026-03-24 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/7.jpg not downloaded yet
2026-03-24 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/8.jpg not downloaded yet
2026-03-24 16:51:23 [ayvens.fr] INFO: Found listing with ID: 1980837
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980837%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [ayvens.fr] INFO: Scrape type for 1980837: 1
2026-03-24 16:51:23 [ayvens.fr] INFO: Extracting data for car ID: 1980837
2026-03-24 16:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c3d1d3-efed-5072-96b0-65aa2e961df1 with identifier: 1980837
2026-03-24 16:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c3d1d3-efed-5072-96b0-65aa2e961df1 with scrape type 1
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/1.jpg not downloaded yet
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/2.jpg not downloaded yet
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e9479cd0>
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/6.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459cfd0>
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/7.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708b50>
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F85ec2148f6a24cb88905716328a739b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/8.jpg saved to cache
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95e58c0f-5804-50ae-b565-64a88beff1cd
2026-03-24 16:51:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95e58c0f-5804-50ae-b565-64a88beff1cd, skipping ID generation
2026-03-24 16:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e58c0f-5804-50ae-b565-64a88beff1cd with scrape type 1
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95e58c0f-5804-50ae-b565-64a88beff1cd sending to next pipeline
2026-03-24 16:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 95e58c0f-5804-50ae-b565-64a88beff1cd, identifier: 1980835
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/3.jpg not downloaded yet
2026-03-24 16:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 95e58c0f-5804-50ae-b565-64a88beff1cd with identifier: 1980835
2026-03-24 16:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 95e58c0f-5804-50ae-b565-64a88beff1cd with identifier: 1980835
2026-03-24 16:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 95e58c0f-5804-50ae-b565-64a88beff1cd with identifier: 1980835 to the API
2026-03-24 16:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '95e58c0f-5804-50ae-b565-64a88beff1cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'KONA',
'odometer': 18074,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e58c0f-5804-50ae-b565-64a88beff1cd/95e58c0f-5804-50ae-b565-64a88beff1cd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/85ec2148f6a24cb88905716328a739b4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI KONA Kona Electric 39kWh - 136ch Creative',
'transmission': 'automatic',
'trim': 'Kona Electric 39kWh - 136ch Creative',
'vin': None,
'year': 2022}
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980835%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [ayvens.fr] INFO: Saving data for 1980835: {'created_time': 1774371084.169038, 'last_price_update_time': 1774371084.169052, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980835') HTTP/1.1" 204 0
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56fe190>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/1.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6a710>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/2.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/4.jpg not downloaded yet
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/5.jpg not downloaded yet
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/6.jpg not downloaded yet
2026-03-24 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/7.jpg not downloaded yet
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/8.jpg not downloaded yet
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613e110>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/3.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [ayvens.fr] INFO: Found listing with ID: 1980838
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980838%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [ayvens.fr] INFO: Scrape type for 1980838: 1
2026-03-24 16:51:24 [ayvens.fr] INFO: Extracting data for car ID: 1980838
2026-03-24 16:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4755d654-f8dc-5cfb-bf22-0b6004564e9e with identifier: 1980838
2026-03-24 16:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e with scrape type 1
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/1.jpg not downloaded yet
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/2.jpg not downloaded yet
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d5d0>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/5.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccf190>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/7.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617cb10>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/4.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8bd0>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/8.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617e990>
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F65ffede8b0314186a3ef31b10425338a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/6.jpg saved to cache
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d66c2496-53bf-5691-b406-0d03da923b3a
2026-03-24 16:51:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d66c2496-53bf-5691-b406-0d03da923b3a, skipping ID generation
2026-03-24 16:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66c2496-53bf-5691-b406-0d03da923b3a with scrape type 1
2026-03-24 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d66c2496-53bf-5691-b406-0d03da923b3a sending to next pipeline
2026-03-24 16:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d66c2496-53bf-5691-b406-0d03da923b3a, identifier: 1980836
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6237590>
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/1.jpg saved to cache
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/3.jpg not downloaded yet
2026-03-24 16:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d66c2496-53bf-5691-b406-0d03da923b3a with identifier: 1980836
2026-03-24 16:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d66c2496-53bf-5691-b406-0d03da923b3a with identifier: 1980836
2026-03-24 16:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d66c2496-53bf-5691-b406-0d03da923b3a with identifier: 1980836 to the API
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'd66c2496-53bf-5691-b406-0d03da923b3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 44799,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66c2496-53bf-5691-b406-0d03da923b3a/d66c2496-53bf-5691-b406-0d03da923b3a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/65ffede8b0314186a3ef31b10425338a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-22',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine Business EAT6 - 2 PLACES',
'transmission': 'automatic',
'trim': 'C3 1.2 PureTech 110ch S&S Shine Business EAT6 - 2 PLACES',
'vin': None,
'year': 2020}
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980836%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [ayvens.fr] INFO: Saving data for 1980836: {'created_time': 1774371085.547781, 'last_price_update_time': 1774371085.547797, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980836') HTTP/1.1" 204 0
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/4.jpg not downloaded yet
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/5.jpg not downloaded yet
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/6.jpg not downloaded yet
2026-03-24 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/7.jpg not downloaded yet
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/8.jpg not downloaded yet
2026-03-24 16:51:25 [ayvens.fr] INFO: Found listing with ID: 1980839
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980839%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [ayvens.fr] INFO: Scrape type for 1980839: 1
2026-03-24 16:51:25 [ayvens.fr] INFO: Extracting data for car ID: 1980839
2026-03-24 16:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef807b18-52a7-55a9-9c68-1ca96427e200 with identifier: 1980839
2026-03-24 16:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef807b18-52a7-55a9-9c68-1ca96427e200 with scrape type 1
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/1.jpg not downloaded yet
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd6fd0>
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/3.jpg saved to cache
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/2.jpg not downloaded yet
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31450>
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/2.jpg saved to cache
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e042d0>
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/5.jpg saved to cache
2026-03-24 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6100210>
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/6.jpg saved to cache
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/3.jpg not downloaded yet
2026-03-24 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/4.jpg not downloaded yet
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573bc10>
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/4.jpg saved to cache
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7ffd0>
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/7.jpg saved to cache
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6367b10>
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/1.jpg saved to cache
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ba3310>
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F3133087712784e428a83c06d237830ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/8.jpg saved to cache
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3c3d1d3-efed-5072-96b0-65aa2e961df1
2026-03-24 16:51:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3c3d1d3-efed-5072-96b0-65aa2e961df1, skipping ID generation
2026-03-24 16:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c3d1d3-efed-5072-96b0-65aa2e961df1 with scrape type 1
2026-03-24 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3c3d1d3-efed-5072-96b0-65aa2e961df1 sending to next pipeline
2026-03-24 16:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b3c3d1d3-efed-5072-96b0-65aa2e961df1, identifier: 1980837
2026-03-24 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b3c3d1d3-efed-5072-96b0-65aa2e961df1 with identifier: 1980837
2026-03-24 16:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b3c3d1d3-efed-5072-96b0-65aa2e961df1 with identifier: 1980837
2026-03-24 16:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b3c3d1d3-efed-5072-96b0-65aa2e961df1 with identifier: 1980837 to the API
2026-03-24 16:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b3c3d1d3-efed-5072-96b0-65aa2e961df1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 109554,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c3d1d3-efed-5072-96b0-65aa2e961df1/b3c3d1d3-efed-5072-96b0-65aa2e961df1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/3133087712784e428a83c06d237830ec/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2020}
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980837%27 HTTP/1.1" 200 None
2026-03-24 16:51:27 [ayvens.fr] INFO: Saving data for 1980837: {'created_time': 1774371087.445446, 'last_price_update_time': 1774371087.445457, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980837') HTTP/1.1" 204 0
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/5.jpg not downloaded yet
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d52010>
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/2.jpg saved to cache
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5caf3d0>
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/4.jpg saved to cache
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/6.jpg not downloaded yet
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e2350>
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/7.jpg saved to cache
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/7.jpg not downloaded yet
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5d710>
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/6.jpg saved to cache
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/8.jpg not downloaded yet
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d7f50>
2026-03-24 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/5.jpg saved to cache
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7ce90>
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/8.jpg saved to cache
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:28 [ayvens.fr] INFO: Found listing with ID: 1980840
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980840%27 HTTP/1.1" 200 None
2026-03-24 16:51:28 [ayvens.fr] INFO: Scrape type for 1980840: 1
2026-03-24 16:51:28 [ayvens.fr] INFO: Extracting data for car ID: 1980840
2026-03-24 16:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 with identifier: 1980840
2026-03-24 16:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 with scrape type 1
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/1.jpg not downloaded yet
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e571aa10>
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F578aafeb178f433d80d71e78ce5abfbf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/3.jpg saved to cache
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e
2026-03-24 16:51:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4755d654-f8dc-5cfb-bf22-0b6004564e9e, skipping ID generation
2026-03-24 16:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e with scrape type 1
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4755d654-f8dc-5cfb-bf22-0b6004564e9e sending to next pipeline
2026-03-24 16:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4755d654-f8dc-5cfb-bf22-0b6004564e9e, identifier: 1980838
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d51ed0>
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/1.jpg saved to cache
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/2.jpg not downloaded yet
2026-03-24 16:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4755d654-f8dc-5cfb-bf22-0b6004564e9e with identifier: 1980838
2026-03-24 16:51:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4755d654-f8dc-5cfb-bf22-0b6004564e9e with identifier: 1980838
2026-03-24 16:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4755d654-f8dc-5cfb-bf22-0b6004564e9e with identifier: 1980838 to the API
2026-03-24 16:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'PHANTOM BLACK',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '4755d654-f8dc-5cfb-bf22-0b6004564e9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 103387,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366606,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4755d654-f8dc-5cfb-bf22-0b6004564e9e/4755d654-f8dc-5cfb-bf22-0b6004564e9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/578aafeb178f433d80d71e78ce5abfbf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'vin': None,
'year': 2022}
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980838%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [ayvens.fr] INFO: Saving data for 1980838: {'created_time': 1774371089.402156, 'last_price_update_time': 1774371089.402172, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980838') HTTP/1.1" 204 0
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fa450>
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/2.jpg saved to cache
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4574c90>
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/3.jpg saved to cache
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/3.jpg not downloaded yet
2026-03-24 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/4.jpg not downloaded yet
2026-03-24 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/5.jpg not downloaded yet
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/6.jpg not downloaded yet
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/7.jpg not downloaded yet
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/8.jpg not downloaded yet
2026-03-24 16:51:29 [ayvens.fr] INFO: Found listing with ID: 1980841
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980841%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [ayvens.fr] INFO: Scrape type for 1980841: 1
2026-03-24 16:51:29 [ayvens.fr] INFO: Extracting data for car ID: 1980841
2026-03-24 16:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17d94eca-eb25-5322-af2f-ccdd7f42fb57 with identifier: 1980841
2026-03-24 16:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57 with scrape type 1
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/1.jpg not downloaded yet
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459ba90>
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/4.jpg saved to cache
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/2.jpg not downloaded yet
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/3.jpg not downloaded yet
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce2350>
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/6.jpg saved to cache
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d350>
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/5.jpg saved to cache
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c2f90>
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/7.jpg saved to cache
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dec490>
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F503dbeb2279d4ddaa29876bf638ed904%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/8.jpg saved to cache
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef807b18-52a7-55a9-9c68-1ca96427e200
2026-03-24 16:51:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef807b18-52a7-55a9-9c68-1ca96427e200, skipping ID generation
2026-03-24 16:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef807b18-52a7-55a9-9c68-1ca96427e200 with scrape type 1
2026-03-24 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef807b18-52a7-55a9-9c68-1ca96427e200 sending to next pipeline
2026-03-24 16:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ef807b18-52a7-55a9-9c68-1ca96427e200, identifier: 1980839
2026-03-24 16:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ef807b18-52a7-55a9-9c68-1ca96427e200 with identifier: 1980839
2026-03-24 16:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ef807b18-52a7-55a9-9c68-1ca96427e200 with identifier: 1980839
2026-03-24 16:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ef807b18-52a7-55a9-9c68-1ca96427e200 with identifier: 1980839 to the API
2026-03-24 16:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 164,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'ef807b18-52a7-55a9-9c68-1ca96427e200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 53780,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef807b18-52a7-55a9-9c68-1ca96427e200/ef807b18-52a7-55a9-9c68-1ca96427e200_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/503dbeb2279d4ddaa29876bf638ed904/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-19',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'vin': None,
'year': 2020}
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980839%27 HTTP/1.1" 200 None
2026-03-24 16:51:31 [ayvens.fr] INFO: Saving data for 1980839: {'created_time': 1774371091.856134, 'last_price_update_time': 1774371091.856146, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980839') HTTP/1.1" 204 0
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/4.jpg not downloaded yet
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/5.jpg not downloaded yet
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/6.jpg not downloaded yet
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/7.jpg not downloaded yet
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/8.jpg not downloaded yet
2026-03-24 16:51:31 [ayvens.fr] INFO: Found listing with ID: 1980842
2026-03-24 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980842%27 HTTP/1.1" 200 None
2026-03-24 16:51:32 [ayvens.fr] INFO: Scrape type for 1980842: 1
2026-03-24 16:51:32 [ayvens.fr] INFO: Extracting data for car ID: 1980842
2026-03-24 16:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7152f217-4686-535e-8881-865d92821bda with identifier: 1980842
2026-03-24 16:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7152f217-4686-535e-8881-865d92821bda with scrape type 1
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/1.jpg not downloaded yet
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61034d0>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/3.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b74b90>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/2.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459d3d0>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/5.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/2.jpg not downloaded yet
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf0e10>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/4.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708110>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/7.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e68c0350>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/1.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6147590>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/6.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cba310>
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F822cf442c0c446c5acbeafc7b597e4cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/8.jpg saved to cache
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0
2026-03-24 16:51:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0, skipping ID generation
2026-03-24 16:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 with scrape type 1
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 sending to next pipeline
2026-03-24 16:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0, identifier: 1980840
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/3.jpg not downloaded yet
2026-03-24 16:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 with identifier: 1980840
2026-03-24 16:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 with identifier: 1980840
2026-03-24 16:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0 with identifier: 1980840 to the API
2026-03-24 16:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'ID.3',
'odometer': 35425,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338143,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0/4c6419a4-dc08-53dc-9f2c-ca3abf3c25d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291757,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/822cf442c0c446c5acbeafc7b597e4cc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seats_number': 4,
'seller_name': None,
'title': 'VOLKSWAGEN ID.3 ID.3 204ch Pro S 77 kWh',
'transmission': 'automatic',
'trim': 'ID.3 204ch Pro S 77 kWh',
'vin': None,
'year': 2022}
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980840%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [ayvens.fr] INFO: Saving data for 1980840: {'created_time': 1774371093.605963, 'last_price_update_time': 1774371093.605974, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980840') HTTP/1.1" 204 0
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/4.jpg not downloaded yet
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/5.jpg not downloaded yet
2026-03-24 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/6.jpg not downloaded yet
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/7.jpg not downloaded yet
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/8.jpg not downloaded yet
2026-03-24 16:51:33 [ayvens.fr] INFO: Found listing with ID: 1980843
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980843%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [ayvens.fr] INFO: Scrape type for 1980843: 1
2026-03-24 16:51:33 [ayvens.fr] INFO: Extracting data for car ID: 1980843
2026-03-24 16:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffdc70c1-7aa7-5ab3-aed6-9484976d2644 with identifier: 1980843
2026-03-24 16:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644 with scrape type 1
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/1.jpg not downloaded yet
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/2.jpg not downloaded yet
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6abd0>
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/4.jpg saved to cache
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/3.jpg not downloaded yet
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b687d0>
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/1.jpg saved to cache
2026-03-24 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60edb10>
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/5.jpg saved to cache
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bebed0>
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/3.jpg saved to cache
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ed0d0>
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/6.jpg saved to cache
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bea2d0>
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/7.jpg saved to cache
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ef290>
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/8.jpg saved to cache
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/4.jpg not downloaded yet
2026-03-24 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/5.jpg not downloaded yet
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4f950>
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F2a387e4611484a24b8c64451dfc264da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/2.jpg saved to cache
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57
2026-03-24 16:51:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17d94eca-eb25-5322-af2f-ccdd7f42fb57, skipping ID generation
2026-03-24 16:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57 with scrape type 1
2026-03-24 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17d94eca-eb25-5322-af2f-ccdd7f42fb57 sending to next pipeline
2026-03-24 16:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 17d94eca-eb25-5322-af2f-ccdd7f42fb57, identifier: 1980841
2026-03-24 16:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 17d94eca-eb25-5322-af2f-ccdd7f42fb57 with identifier: 1980841
2026-03-24 16:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 17d94eca-eb25-5322-af2f-ccdd7f42fb57 with identifier: 1980841
2026-03-24 16:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 17d94eca-eb25-5322-af2f-ccdd7f42fb57 with identifier: 1980841 to the API
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '17d94eca-eb25-5322-af2f-ccdd7f42fb57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 10783,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17d94eca-eb25-5322-af2f-ccdd7f42fb57/17d94eca-eb25-5322-af2f-ccdd7f42fb57_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/2a387e4611484a24b8c64451dfc264da/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 110ch S&S Shine',
'vin': None,
'year': 2023}
2026-03-24 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980841%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [ayvens.fr] INFO: Saving data for 1980841: {'created_time': 1774371095.004022, 'last_price_update_time': 1774371095.004033, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980841') HTTP/1.1" 204 0
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/6.jpg not downloaded yet
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/7.jpg not downloaded yet
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbae10>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/6.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/8.jpg not downloaded yet
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf5310>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/4.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f8210>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/3.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [ayvens.fr] INFO: Found listing with ID: 1980844
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980844%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [ayvens.fr] INFO: Scrape type for 1980844: 1
2026-03-24 16:51:35 [ayvens.fr] INFO: Extracting data for car ID: 1980844
2026-03-24 16:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8b2df32-a6d8-5c07-94c6-068e2722eb0c with identifier: 1980844
2026-03-24 16:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c with scrape type 1
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/1.jpg not downloaded yet
2026-03-24 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d55990>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/1.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bc050>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/2.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56db490>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/8.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3a5d0>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/5.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1390>
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F0ced1efa609b497fa2fc73a762803953%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/7.jpg saved to cache
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7152f217-4686-535e-8881-865d92821bda
2026-03-24 16:51:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7152f217-4686-535e-8881-865d92821bda, skipping ID generation
2026-03-24 16:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7152f217-4686-535e-8881-865d92821bda with scrape type 1
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7152f217-4686-535e-8881-865d92821bda sending to next pipeline
2026-03-24 16:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7152f217-4686-535e-8881-865d92821bda, identifier: 1980842
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/2.jpg not downloaded yet
2026-03-24 16:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7152f217-4686-535e-8881-865d92821bda with identifier: 1980842
2026-03-24 16:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7152f217-4686-535e-8881-865d92821bda with identifier: 1980842
2026-03-24 16:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7152f217-4686-535e-8881-865d92821bda with identifier: 1980842 to the API
2026-03-24 16:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '7152f217-4686-535e-8881-865d92821bda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 76254,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152f217-4686-535e-8881-865d92821bda/7152f217-4686-535e-8881-865d92821bda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/0ced1efa609b497fa2fc73a762803953/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-15',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 2.0 BlueHDi 180ch S&S Driver EAT8',
'transmission': 'automatic',
'trim': 'Jumpy Fg M 2.0 BlueHDi 180ch S&S Driver EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980842%27 HTTP/1.1" 200 None
2026-03-24 16:51:36 [ayvens.fr] INFO: Saving data for 1980842: {'created_time': 1774371096.573116, 'last_price_update_time': 1774371096.573127, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980842') HTTP/1.1" 204 0
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/3.jpg not downloaded yet
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/4.jpg not downloaded yet
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7da3750>
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/1.jpg saved to cache
2026-03-24 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/5.jpg not downloaded yet
2026-03-24 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f2350>
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/6.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce090>
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/2.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/6.jpg not downloaded yet
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4ecd0>
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/5.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621c250>
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/7.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56a6250>
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/3.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a6d0>
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/4.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/7.jpg not downloaded yet
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708610>
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F5362a00af51241baa81e3826a2816253%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/8.jpg saved to cache
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644
2026-03-24 16:51:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffdc70c1-7aa7-5ab3-aed6-9484976d2644, skipping ID generation
2026-03-24 16:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644 with scrape type 1
2026-03-24 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffdc70c1-7aa7-5ab3-aed6-9484976d2644 sending to next pipeline
2026-03-24 16:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ffdc70c1-7aa7-5ab3-aed6-9484976d2644, identifier: 1980843
2026-03-24 16:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ffdc70c1-7aa7-5ab3-aed6-9484976d2644 with identifier: 1980843
2026-03-24 16:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ffdc70c1-7aa7-5ab3-aed6-9484976d2644 with identifier: 1980843
2026-03-24 16:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ffdc70c1-7aa7-5ab3-aed6-9484976d2644 with identifier: 1980843 to the API
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'ffdc70c1-7aa7-5ab3-aed6-9484976d2644',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 131393,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc70c1-7aa7-5ab3-aed6-9484976d2644/ffdc70c1-7aa7-5ab3-aed6-9484976d2644_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337196,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/5362a00af51241baa81e3826a2816253/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt',
'vin': None,
'year': 2019}
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980843%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [ayvens.fr] INFO: Saving data for 1980843: {'created_time': 1774371098.425026, 'last_price_update_time': 1774371098.425039, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980843') HTTP/1.1" 204 0
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/8.jpg not downloaded yet
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [ayvens.fr] INFO: Found listing with ID: 1980845
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980845%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [ayvens.fr] INFO: Scrape type for 1980845: 1
2026-03-24 16:51:38 [ayvens.fr] INFO: Extracting data for car ID: 1980845
2026-03-24 16:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d with identifier: 1980845
2026-03-24 16:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d with scrape type 1
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/1.jpg not downloaded yet
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/2.jpg not downloaded yet
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/3.jpg not downloaded yet
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/4.jpg not downloaded yet
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/5.jpg not downloaded yet
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/6.jpg not downloaded yet
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56c8050>
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/1.jpg saved to cache
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8a90>
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/2.jpg saved to cache
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459e390>
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/3.jpg saved to cache
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/7.jpg not downloaded yet
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/8.jpg not downloaded yet
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:38 [ayvens.fr] INFO: Found listing with ID: 1980846
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980846%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [ayvens.fr] INFO: Scrape type for 1980846: 1
2026-03-24 16:51:38 [ayvens.fr] INFO: Extracting data for car ID: 1980846
2026-03-24 16:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a6d244-0184-544b-bc2e-d7b2baeee2f7 with identifier: 1980846
2026-03-24 16:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7 with scrape type 1
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/1.jpg not downloaded yet
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56a6310>
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/4.jpg saved to cache
2026-03-24 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459c750>
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/5.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/2.jpg not downloaded yet
2026-03-24 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103110>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/7.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d0b350>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/1.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3b210>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/4.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/3.jpg not downloaded yet
2026-03-24 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/4.jpg not downloaded yet
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4599910>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/6.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5f390>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/3.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d990>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/2.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7ced410>
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F0b491cd086954231a864fe048e88e3cd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/8.jpg saved to cache
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c
2026-03-24 16:51:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8b2df32-a6d8-5c07-94c6-068e2722eb0c, skipping ID generation
2026-03-24 16:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c with scrape type 1
2026-03-24 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8b2df32-a6d8-5c07-94c6-068e2722eb0c sending to next pipeline
2026-03-24 16:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c8b2df32-a6d8-5c07-94c6-068e2722eb0c, identifier: 1980844
2026-03-24 16:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c8b2df32-a6d8-5c07-94c6-068e2722eb0c with identifier: 1980844
2026-03-24 16:51:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c8b2df32-a6d8-5c07-94c6-068e2722eb0c with identifier: 1980844
2026-03-24 16:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c8b2df32-a6d8-5c07-94c6-068e2722eb0c with identifier: 1980844 to the API
2026-03-24 16:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLEU SIGNAL',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'c8b2df32-a6d8-5c07-94c6-068e2722eb0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'MOVANO',
'odometer': 128190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b2df32-a6d8-5c07-94c6-068e2722eb0c/c8b2df32-a6d8-5c07-94c6-068e2722eb0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/0b491cd086954231a864fe048e88e3cd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-24',
'seats_number': 3,
'seller_name': None,
'title': 'OPEL MOVANO Movano Fg F3500 L2H2 2.3 CDTI 135ch BiTurbo Start/Stop',
'transmission': 'manual',
'trim': 'Movano Fg F3500 L2H2 2.3 CDTI 135ch BiTurbo Start/Stop',
'vin': None,
'year': 2020}
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980844%27 HTTP/1.1" 200 None
2026-03-24 16:51:40 [ayvens.fr] INFO: Saving data for 1980844: {'created_time': 1774371100.223495, 'last_price_update_time': 1774371100.223507, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980844') HTTP/1.1" 204 0
2026-03-24 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/5.jpg not downloaded yet
2026-03-24 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3bd0>
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/5.jpg saved to cache
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456f810>
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/6.jpg saved to cache
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/6.jpg not downloaded yet
2026-03-24 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/7.jpg not downloaded yet
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc8f10>
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/7.jpg saved to cache
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c57710>
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fd9cd35247e644b0189384cdc8b5abdab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/8.jpg saved to cache
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d
2026-03-24 16:51:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d, skipping ID generation
2026-03-24 16:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d with scrape type 1
2026-03-24 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d sending to next pipeline
2026-03-24 16:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d, identifier: 1980845
2026-03-24 16:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d with identifier: 1980845
2026-03-24 16:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d with identifier: 1980845
2026-03-24 16:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 079a3445-0faa-5dbb-ad79-d4ba65bfcb1d with identifier: 1980845 to the API
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '079a3445-0faa-5dbb-ad79-d4ba65bfcb1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 94368,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079a3445-0faa-5dbb-ad79-d4ba65bfcb1d/079a3445-0faa-5dbb-ad79-d4ba65bfcb1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/d9cd35247e644b0189384cdc8b5abdab/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-06',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'vin': None,
'year': 2022}
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980845%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [ayvens.fr] INFO: Saving data for 1980845: {'created_time': 1774371101.029029, 'last_price_update_time': 1774371101.029044, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980845') HTTP/1.1" 204 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/8.jpg not downloaded yet
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cacc10>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/1.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bac250>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/2.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [ayvens.fr] INFO: Found listing with ID: 1980847
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980847%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [ayvens.fr] INFO: Scrape type for 1980847: 1
2026-03-24 16:51:41 [ayvens.fr] INFO: Extracting data for car ID: 1980847
2026-03-24 16:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798968fd-91a4-5e19-987e-d9476db4a641 with identifier: 1980847
2026-03-24 16:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798968fd-91a4-5e19-987e-d9476db4a641 with scrape type 1
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/1.jpg not downloaded yet
2026-03-24 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/2.jpg not downloaded yet
2026-03-24 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/3.jpg not downloaded yet
2026-03-24 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/4.jpg not downloaded yet
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/5.jpg not downloaded yet
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/6.jpg not downloaded yet
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/7.jpg not downloaded yet
2026-03-24 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/8.jpg not downloaded yet
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56ffb10>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/3.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [ayvens.fr] INFO: Found listing with ID: 1980848
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980848%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [ayvens.fr] INFO: Scrape type for 1980848: 1
2026-03-24 16:51:41 [ayvens.fr] INFO: Extracting data for car ID: 1980848
2026-03-24 16:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 291b8b42-ce71-5c2b-87f2-b2d632009238 with identifier: 1980848
2026-03-24 16:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291b8b42-ce71-5c2b-87f2-b2d632009238 with scrape type 1
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/1.jpg not downloaded yet
2026-03-24 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb8910>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/5.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d59050>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/4.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/2.jpg not downloaded yet
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cadc90>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/6.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605b890>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/7.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/3.jpg not downloaded yet
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b1990>
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F07aa74a6bc974538a856a2923aa1e027%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/8.jpg saved to cache
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7
2026-03-24 16:51:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7a6d244-0184-544b-bc2e-d7b2baeee2f7, skipping ID generation
2026-03-24 16:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7 with scrape type 1
2026-03-24 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7a6d244-0184-544b-bc2e-d7b2baeee2f7 sending to next pipeline
2026-03-24 16:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a7a6d244-0184-544b-bc2e-d7b2baeee2f7, identifier: 1980846
2026-03-24 16:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a7a6d244-0184-544b-bc2e-d7b2baeee2f7 with identifier: 1980846
2026-03-24 16:51:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a7a6d244-0184-544b-bc2e-d7b2baeee2f7 with identifier: 1980846
2026-03-24 16:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a7a6d244-0184-544b-bc2e-d7b2baeee2f7 with identifier: 1980846 to the API
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 45,
'color': 'SOPHISTOGRAU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'a7a6d244-0184-544b-bc2e-d7b2baeee2f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 67163,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312759,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a6d244-0184-544b-bc2e-d7b2baeee2f7/a7a6d244-0184-544b-bc2e-d7b2baeee2f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/07aa74a6bc974538a856a2923aa1e027/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30e 292ch Business Design',
'transmission': 'automatic',
'trim': 'X3 xDrive30e 292ch Business Design',
'vin': None,
'year': 2023}
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980846%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [ayvens.fr] INFO: Saving data for 1980846: {'created_time': 1774371102.341232, 'last_price_update_time': 1774371102.341248, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980846') HTTP/1.1" 204 0
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/4.jpg not downloaded yet
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/5.jpg not downloaded yet
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/6.jpg not downloaded yet
2026-03-24 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/7.jpg not downloaded yet
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/8.jpg not downloaded yet
2026-03-24 16:51:42 [ayvens.fr] INFO: Found listing with ID: 1980849
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980849%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [ayvens.fr] INFO: Scrape type for 1980849: 1
2026-03-24 16:51:42 [ayvens.fr] INFO: Extracting data for car ID: 1980849
2026-03-24 16:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 with identifier: 1980849
2026-03-24 16:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 with scrape type 1
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/1.jpg not downloaded yet
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/2.jpg not downloaded yet
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/3.jpg not downloaded yet
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e38310>
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/3.jpg saved to cache
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c81e50>
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/1.jpg saved to cache
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08190>
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/6.jpg saved to cache
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/4.jpg not downloaded yet
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4fb50>
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/7.jpg saved to cache
2026-03-24 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32710>
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/2.jpg saved to cache
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32bd0>
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/4.jpg saved to cache
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce3350>
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/5.jpg saved to cache
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/5.jpg not downloaded yet
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a07110>
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fddd44dd463b9453d9000e738776177ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/8.jpg saved to cache
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798968fd-91a4-5e19-987e-d9476db4a641
2026-03-24 16:51:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798968fd-91a4-5e19-987e-d9476db4a641, skipping ID generation
2026-03-24 16:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798968fd-91a4-5e19-987e-d9476db4a641 with scrape type 1
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798968fd-91a4-5e19-987e-d9476db4a641 sending to next pipeline
2026-03-24 16:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 798968fd-91a4-5e19-987e-d9476db4a641, identifier: 1980847
2026-03-24 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/6.jpg not downloaded yet
2026-03-24 16:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 798968fd-91a4-5e19-987e-d9476db4a641 with identifier: 1980847
2026-03-24 16:51:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 798968fd-91a4-5e19-987e-d9476db4a641 with identifier: 1980847
2026-03-24 16:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 798968fd-91a4-5e19-987e-d9476db4a641 with identifier: 1980847 to the API
2026-03-24 16:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLANC OK',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '798968fd-91a4-5e19-987e-d9476db4a641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 45508,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798968fd-91a4-5e19-987e-d9476db4a641/798968fd-91a4-5e19-987e-d9476db4a641_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ddd44dd463b9453d9000e738776177ba/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980847%27 HTTP/1.1" 200 None
2026-03-24 16:51:44 [ayvens.fr] INFO: Saving data for 1980847: {'created_time': 1774371104.459116, 'last_price_update_time': 1774371104.459127, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980847') HTTP/1.1" 204 0
2026-03-24 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/7.jpg not downloaded yet
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4d290>
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/7.jpg saved to cache
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/8.jpg not downloaded yet
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f5e50>
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/3.jpg saved to cache
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629c510>
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/5.jpg saved to cache
2026-03-24 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f9e50>
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/6.jpg saved to cache
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9fa50>
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/4.jpg saved to cache
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d9c10>
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/8.jpg saved to cache
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc1390>
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/2.jpg saved to cache
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e05d0>
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc98f72b7c3dc4e73acd752a07204cf36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/1.jpg saved to cache
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 291b8b42-ce71-5c2b-87f2-b2d632009238
2026-03-24 16:51:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 291b8b42-ce71-5c2b-87f2-b2d632009238, skipping ID generation
2026-03-24 16:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291b8b42-ce71-5c2b-87f2-b2d632009238 with scrape type 1
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 291b8b42-ce71-5c2b-87f2-b2d632009238 sending to next pipeline
2026-03-24 16:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 291b8b42-ce71-5c2b-87f2-b2d632009238, identifier: 1980848
2026-03-24 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:45 [ayvens.fr] INFO: Found listing with ID: 1980850
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980850%27 HTTP/1.1" 200 None
2026-03-24 16:51:45 [ayvens.fr] INFO: Scrape type for 1980850: 1
2026-03-24 16:51:45 [ayvens.fr] INFO: Extracting data for car ID: 1980850
2026-03-24 16:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ac8151-d7c9-53fc-96aa-05dce85ef365 with identifier: 1980850
2026-03-24 16:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ac8151-d7c9-53fc-96aa-05dce85ef365 with scrape type 1
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/1.jpg not downloaded yet
2026-03-24 16:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 291b8b42-ce71-5c2b-87f2-b2d632009238 with identifier: 1980848
2026-03-24 16:51:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 291b8b42-ce71-5c2b-87f2-b2d632009238 with identifier: 1980848
2026-03-24 16:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 291b8b42-ce71-5c2b-87f2-b2d632009238 with identifier: 1980848 to the API
2026-03-24 16:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'GRIS HIGHLAND',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '291b8b42-ce71-5c2b-87f2-b2d632009238',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 61136,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327471,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291b8b42-ce71-5c2b-87f2-b2d632009238/291b8b42-ce71-5c2b-87f2-b2d632009238_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c98f72b7c3dc4e73acd752a07204cf36/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.3 TCe 140ch Techno EDC',
'transmission': 'automatic',
'trim': 'Megane 1.3 TCe 140ch Techno EDC',
'vin': None,
'year': 2022}
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980848%27 HTTP/1.1" 200 None
2026-03-24 16:51:46 [ayvens.fr] INFO: Saving data for 1980848: {'created_time': 1774371106.561562, 'last_price_update_time': 1774371106.561575, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980848') HTTP/1.1" 204 0
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/2.jpg not downloaded yet
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bffdd0>
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/1.jpg saved to cache
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/3.jpg not downloaded yet
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/4.jpg not downloaded yet
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc15d0>
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/2.jpg saved to cache
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/5.jpg not downloaded yet
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9dd10>
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/5.jpg saved to cache
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/6.jpg not downloaded yet
2026-03-24 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08150>
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/6.jpg saved to cache
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d592d0>
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/4.jpg saved to cache
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ca6cd0>
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/3.jpg saved to cache
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c898d0>
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/7.jpg saved to cache
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/7.jpg not downloaded yet
2026-03-24 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/8.jpg not downloaded yet
2026-03-24 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d107d0>
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F528ee36f93cb4c8ca14dc51a46fa7b19%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/8.jpg saved to cache
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6
2026-03-24 16:51:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6, skipping ID generation
2026-03-24 16:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 with scrape type 1
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 sending to next pipeline
2026-03-24 16:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6, identifier: 1980849
2026-03-24 16:51:47 [ayvens.fr] INFO: Found listing with ID: 1980851
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980851%27 HTTP/1.1" 200 None
2026-03-24 16:51:47 [ayvens.fr] INFO: Scrape type for 1980851: 1
2026-03-24 16:51:47 [ayvens.fr] INFO: Extracting data for car ID: 1980851
2026-03-24 16:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9bec53c-6477-529f-afad-67f65aec366e with identifier: 1980851
2026-03-24 16:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9bec53c-6477-529f-afad-67f65aec366e with scrape type 1
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/1.jpg not downloaded yet
2026-03-24 16:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 with identifier: 1980849
2026-03-24 16:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 with identifier: 1980849
2026-03-24 16:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6 with identifier: 1980849 to the API
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208 BUSINESS R',
'odometer': 50360,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6/4911d236-cb1c-5196-bc8d-b1a6bbb7b0a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/528ee36f93cb4c8ca14dc51a46fa7b19/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-08',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT E-208 BUSINESS R 208 Business R e-208 136ch Active',
'transmission': 'automatic',
'trim': '208 Business R e-208 136ch Active',
'vin': None,
'year': 2021}
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980849%27 HTTP/1.1" 200 None
2026-03-24 16:51:47 [ayvens.fr] INFO: Saving data for 1980849: {'created_time': 1774371107.893679, 'last_price_update_time': 1774371107.893691, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980849') HTTP/1.1" 204 0
2026-03-24 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/2.jpg not downloaded yet
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7e810>
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/1.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c05150>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/2.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/3.jpg not downloaded yet
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/4.jpg not downloaded yet
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c73750>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/3.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61038d0>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/4.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/5.jpg not downloaded yet
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/6.jpg not downloaded yet
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcf350>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/5.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bc910>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/6.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6119cd0>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/7.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/7.jpg not downloaded yet
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/8.jpg not downloaded yet
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [ayvens.fr] INFO: Found listing with ID: 1980852
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980852%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [ayvens.fr] INFO: Scrape type for 1980852: 1
2026-03-24 16:51:48 [ayvens.fr] INFO: Extracting data for car ID: 1980852
2026-03-24 16:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34664ce-24aa-56ba-8f6c-69951cd5a9ae with identifier: 1980852
2026-03-24 16:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae with scrape type 1
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/1.jpg not downloaded yet
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/2.jpg not downloaded yet
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4410>
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff234de5753214044a68f8b61893f4c83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/8.jpg saved to cache
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05ac8151-d7c9-53fc-96aa-05dce85ef365
2026-03-24 16:51:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05ac8151-d7c9-53fc-96aa-05dce85ef365, skipping ID generation
2026-03-24 16:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ac8151-d7c9-53fc-96aa-05dce85ef365 with scrape type 1
2026-03-24 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05ac8151-d7c9-53fc-96aa-05dce85ef365 sending to next pipeline
2026-03-24 16:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 05ac8151-d7c9-53fc-96aa-05dce85ef365, identifier: 1980850
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/3.jpg not downloaded yet
2026-03-24 16:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 05ac8151-d7c9-53fc-96aa-05dce85ef365 with identifier: 1980850
2026-03-24 16:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 05ac8151-d7c9-53fc-96aa-05dce85ef365 with identifier: 1980850
2026-03-24 16:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 05ac8151-d7c9-53fc-96aa-05dce85ef365 with identifier: 1980850 to the API
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'SAPHIR SCHWARZ METAL NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '05ac8151-d7c9-53fc-96aa-05dce85ef365',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 55121,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383404,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ac8151-d7c9-53fc-96aa-05dce85ef365/05ac8151-d7c9-53fc-96aa-05dce85ef365_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f234de5753214044a68f8b61893f4c83/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch Business Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch Business Design DKG7',
'vin': None,
'year': 2023}
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980850%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [ayvens.fr] INFO: Saving data for 1980850: {'created_time': 1774371109.446617, 'last_price_update_time': 1774371109.446629, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980850') HTTP/1.1" 204 0
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f41e9290>
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/2.jpg saved to cache
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/4.jpg not downloaded yet
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d3610>
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/1.jpg saved to cache
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33a10>
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/3.jpg saved to cache
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c63350>
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/4.jpg saved to cache
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/5.jpg not downloaded yet
2026-03-24 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/6.jpg not downloaded yet
2026-03-24 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/7.jpg not downloaded yet
2026-03-24 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/8.jpg not downloaded yet
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617e910>
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/7.jpg saved to cache
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3cf90>
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/5.jpg saved to cache
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629ca50>
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/8.jpg saved to cache
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce810>
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/1.jpg saved to cache
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c82b10>
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252Ff161e2bc46bd4c2895bd5bd236dd8030%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/6.jpg saved to cache
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9bec53c-6477-529f-afad-67f65aec366e
2026-03-24 16:51:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9bec53c-6477-529f-afad-67f65aec366e, skipping ID generation
2026-03-24 16:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9bec53c-6477-529f-afad-67f65aec366e with scrape type 1
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9bec53c-6477-529f-afad-67f65aec366e sending to next pipeline
2026-03-24 16:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c9bec53c-6477-529f-afad-67f65aec366e, identifier: 1980851
2026-03-24 16:51:50 [ayvens.fr] INFO: Found listing with ID: 1980853
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980853%27 HTTP/1.1" 200 None
2026-03-24 16:51:50 [ayvens.fr] INFO: Scrape type for 1980853: 1
2026-03-24 16:51:50 [ayvens.fr] INFO: Extracting data for car ID: 1980853
2026-03-24 16:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba464794-a62e-5402-9414-912338f4e971 with identifier: 1980853
2026-03-24 16:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba464794-a62e-5402-9414-912338f4e971 with scrape type 1
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/1.jpg not downloaded yet
2026-03-24 16:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c9bec53c-6477-529f-afad-67f65aec366e with identifier: 1980851
2026-03-24 16:51:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c9bec53c-6477-529f-afad-67f65aec366e with identifier: 1980851
2026-03-24 16:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c9bec53c-6477-529f-afad-67f65aec366e with identifier: 1980851 to the API
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'color': 'BLEU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c9bec53c-6477-529f-afad-67f65aec366e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'LYNK & CO',
'model': 'LC01',
'odometer': 92830,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bec53c-6477-529f-afad-67f65aec366e/c9bec53c-6477-529f-afad-67f65aec366e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/f161e2bc46bd4c2895bd5bd236dd8030/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'LYNK & CO LC01 1 1.5 PHEV 261ch DCTH 7',
'transmission': 'automatic',
'trim': '1 1.5 PHEV 261ch DCTH 7',
'vin': None,
'year': 2024}
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980851%27 HTTP/1.1" 200 None
2026-03-24 16:51:50 [ayvens.fr] INFO: Saving data for 1980851: {'created_time': 1774371110.900851, 'last_price_update_time': 1774371110.900863, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980851') HTTP/1.1" 204 0
2026-03-24 16:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/2.jpg not downloaded yet
2026-03-24 16:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87250>
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/2.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/3.jpg not downloaded yet
2026-03-24 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/4.jpg not downloaded yet
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6237150>
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/4.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb8f50>
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/3.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/5.jpg not downloaded yet
2026-03-24 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/6.jpg not downloaded yet
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e57197d0>
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/6.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09b50>
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/5.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6102f90>
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/7.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/7.jpg not downloaded yet
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/8.jpg not downloaded yet
2026-03-24 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b69250>
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1a9400cb47e645478697420c5df5ce5a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/8.jpg saved to cache
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae
2026-03-24 16:51:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c34664ce-24aa-56ba-8f6c-69951cd5a9ae, skipping ID generation
2026-03-24 16:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae with scrape type 1
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c34664ce-24aa-56ba-8f6c-69951cd5a9ae sending to next pipeline
2026-03-24 16:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c34664ce-24aa-56ba-8f6c-69951cd5a9ae, identifier: 1980852
2026-03-24 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:51 [ayvens.fr] INFO: Found listing with ID: 1980854
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980854%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [ayvens.fr] INFO: Scrape type for 1980854: 1
2026-03-24 16:51:51 [ayvens.fr] INFO: Extracting data for car ID: 1980854
2026-03-24 16:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d69e9b93-f479-59f0-bcb2-b486be471c8b with identifier: 1980854
2026-03-24 16:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d69e9b93-f479-59f0-bcb2-b486be471c8b with scrape type 1
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/1.jpg not downloaded yet
2026-03-24 16:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c34664ce-24aa-56ba-8f6c-69951cd5a9ae with identifier: 1980852
2026-03-24 16:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c34664ce-24aa-56ba-8f6c-69951cd5a9ae with identifier: 1980852
2026-03-24 16:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c34664ce-24aa-56ba-8f6c-69951cd5a9ae with identifier: 1980852 to the API
2026-03-24 16:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'c34664ce-24aa-56ba-8f6c-69951cd5a9ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS7',
'odometer': 58179,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228557,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34664ce-24aa-56ba-8f6c-69951cd5a9ae/c34664ce-24aa-56ba-8f6c-69951cd5a9ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1a9400cb47e645478697420c5df5ce5a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS7 DS 7 Crossback PureTech 180ch Rivoli Automatique',
'transmission': 'automatic',
'trim': 'DS 7 Crossback PureTech 180ch Rivoli Automatique',
'vin': None,
'year': 2022}
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980852%27 HTTP/1.1" 200 None
2026-03-24 16:51:52 [ayvens.fr] INFO: Saving data for 1980852: {'created_time': 1774371112.666104, 'last_price_update_time': 1774371112.666115, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980852') HTTP/1.1" 204 0
2026-03-24 16:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/2.jpg not downloaded yet
2026-03-24 16:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84ad0>
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/1.jpg saved to cache
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd7210>
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/2.jpg saved to cache
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/3.jpg not downloaded yet
2026-03-24 16:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/4.jpg not downloaded yet
2026-03-24 16:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e454c110>
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/4.jpg saved to cache
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7fd50>
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/3.jpg saved to cache
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/5.jpg not downloaded yet
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/6.jpg not downloaded yet
2026-03-24 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b76610>
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/5.jpg saved to cache
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6040890>
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/6.jpg saved to cache
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf6790>
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/7.jpg saved to cache
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/7.jpg not downloaded yet
2026-03-24 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/8.jpg not downloaded yet
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6040250>
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fa2bb825a57754f13b1710e8c96dad94b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/8.jpg saved to cache
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba464794-a62e-5402-9414-912338f4e971
2026-03-24 16:51:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba464794-a62e-5402-9414-912338f4e971, skipping ID generation
2026-03-24 16:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba464794-a62e-5402-9414-912338f4e971 with scrape type 1
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba464794-a62e-5402-9414-912338f4e971 sending to next pipeline
2026-03-24 16:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ba464794-a62e-5402-9414-912338f4e971, identifier: 1980853
2026-03-24 16:51:53 [ayvens.fr] INFO: Found listing with ID: 1980855
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980855%27 HTTP/1.1" 200 None
2026-03-24 16:51:53 [ayvens.fr] INFO: Scrape type for 1980855: 1
2026-03-24 16:51:53 [ayvens.fr] INFO: Extracting data for car ID: 1980855
2026-03-24 16:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09614916-6146-5c4d-8870-eb84312d6bcc with identifier: 1980855
2026-03-24 16:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09614916-6146-5c4d-8870-eb84312d6bcc with scrape type 1
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/1.jpg not downloaded yet
2026-03-24 16:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ba464794-a62e-5402-9414-912338f4e971 with identifier: 1980853
2026-03-24 16:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ba464794-a62e-5402-9414-912338f4e971 with identifier: 1980853
2026-03-24 16:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ba464794-a62e-5402-9414-912338f4e971 with identifier: 1980853 to the API
2026-03-24 16:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'GRIS PLATINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'ba464794-a62e-5402-9414-912338f4e971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 38463,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345952,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba464794-a62e-5402-9414-912338f4e971/ba464794-a62e-5402-9414-912338f4e971_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/a2bb825a57754f13b1710e8c96dad94b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-22',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.0 TCe 90ch Business N',
'transmission': 'manual',
'trim': 'Clio Réversible 1.0 TCe 90ch Business N',
'vin': None,
'year': 2021}
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980853%27 HTTP/1.1" 200 None
2026-03-24 16:51:54 [ayvens.fr] INFO: Saving data for 1980853: {'created_time': 1774371114.238828, 'last_price_update_time': 1774371114.238842, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980853') HTTP/1.1" 204 0
2026-03-24 16:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/2.jpg not downloaded yet
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c79550>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/1.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1ebd0>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/2.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/3.jpg not downloaded yet
2026-03-24 16:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/4.jpg not downloaded yet
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6041250>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/3.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61fd0>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/4.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/5.jpg not downloaded yet
2026-03-24 16:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/6.jpg not downloaded yet
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d9390>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/6.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d315d0>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/7.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56e0190>
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/5.jpg saved to cache
2026-03-24 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/7.jpg not downloaded yet
2026-03-24 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629e9d0>
2026-03-24 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fcbe46877004947b2ac5c739a3b2e7675%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/8.jpg saved to cache
2026-03-24 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d69e9b93-f479-59f0-bcb2-b486be471c8b
2026-03-24 16:51:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d69e9b93-f479-59f0-bcb2-b486be471c8b, skipping ID generation
2026-03-24 16:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d69e9b93-f479-59f0-bcb2-b486be471c8b with scrape type 1
2026-03-24 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d69e9b93-f479-59f0-bcb2-b486be471c8b sending to next pipeline
2026-03-24 16:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d69e9b93-f479-59f0-bcb2-b486be471c8b, identifier: 1980854
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/8.jpg not downloaded yet
2026-03-24 16:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d69e9b93-f479-59f0-bcb2-b486be471c8b with identifier: 1980854
2026-03-24 16:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d69e9b93-f479-59f0-bcb2-b486be471c8b with identifier: 1980854
2026-03-24 16:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d69e9b93-f479-59f0-bcb2-b486be471c8b with identifier: 1980854 to the API
2026-03-24 16:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': 'd69e9b93-f479-59f0-bcb2-b486be471c8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208 BUSINESS R',
'odometer': 60360,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e9b93-f479-59f0-bcb2-b486be471c8b/d69e9b93-f479-59f0-bcb2-b486be471c8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/cbe46877004947b2ac5c739a3b2e7675/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-08',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT E-208 BUSINESS R 208 Business R e-208 136ch Active',
'transmission': 'automatic',
'trim': '208 Business R e-208 136ch Active',
'vin': None,
'year': 2021}
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980854%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [ayvens.fr] INFO: Saving data for 1980854: {'created_time': 1774371117.847469, 'last_price_update_time': 1774371117.84748, 'auction_closing_time': 1774605600.0}
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980854') HTTP/1.1" 204 0
2026-03-24 16:51:57 [ayvens.fr] INFO: Found listing with ID: 1980856
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980856%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [ayvens.fr] INFO: Scrape type for 1980856: 1
2026-03-24 16:51:57 [ayvens.fr] INFO: Extracting data for car ID: 1980856
2026-03-24 16:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78eab18d-74d8-5bc8-87c2-2d1870351e53 with identifier: 1980856
2026-03-24 16:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78eab18d-74d8-5bc8-87c2-2d1870351e53 with scrape type 1
2026-03-24 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/1.jpg not downloaded yet
2026-03-24 16:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/2.jpg not downloaded yet
2026-03-24 16:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/3.jpg not downloaded yet
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/4.jpg not downloaded yet
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/5.jpg not downloaded yet
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/6.jpg not downloaded yet
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/7.jpg not downloaded yet
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/8.jpg not downloaded yet
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [ayvens.fr] INFO: Found listing with ID: 1980857
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980857%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [ayvens.fr] INFO: Scrape type for 1980857: 1
2026-03-24 16:51:58 [ayvens.fr] INFO: Extracting data for car ID: 1980857
2026-03-24 16:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9d1126-cf23-54b9-ae5f-91c75dec9f6f with identifier: 1980857
2026-03-24 16:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f with scrape type 1
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/1.jpg not downloaded yet
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c60750>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/2.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce2450>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/1.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0ec50>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/4.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570b410>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/3.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/2.jpg not downloaded yet
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f9a50>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/5.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/3.jpg not downloaded yet
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e38090>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/7.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4598ad0>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/6.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/4.jpg not downloaded yet
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/5.jpg not downloaded yet
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/6.jpg not downloaded yet
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/7.jpg not downloaded yet
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/8.jpg not downloaded yet
2026-03-24 16:51:58 [ayvens.fr] INFO: Found listing with ID: 1980858
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980858%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [ayvens.fr] INFO: Scrape type for 1980858: 1
2026-03-24 16:51:58 [ayvens.fr] INFO: Extracting data for car ID: 1980858
2026-03-24 16:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72081f48-6e6a-5c85-be14-8ac97d910a22 with identifier: 1980858
2026-03-24 16:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72081f48-6e6a-5c85-be14-8ac97d910a22 with scrape type 1
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/1.jpg not downloaded yet
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/2.jpg not downloaded yet
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8290>
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fad93d6d79e9141f38af9ca318db9a6e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/8.jpg saved to cache
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09614916-6146-5c4d-8870-eb84312d6bcc
2026-03-24 16:51:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09614916-6146-5c4d-8870-eb84312d6bcc, skipping ID generation
2026-03-24 16:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09614916-6146-5c4d-8870-eb84312d6bcc with scrape type 1
2026-03-24 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09614916-6146-5c4d-8870-eb84312d6bcc sending to next pipeline
2026-03-24 16:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 09614916-6146-5c4d-8870-eb84312d6bcc, identifier: 1980855
2026-03-24 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d027d0>
2026-03-24 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/6.jpg saved to cache
2026-03-24 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/3.jpg not downloaded yet
2026-03-24 16:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 09614916-6146-5c4d-8870-eb84312d6bcc with identifier: 1980855
2026-03-24 16:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 09614916-6146-5c4d-8870-eb84312d6bcc with identifier: 1980855
2026-03-24 16:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 09614916-6146-5c4d-8870-eb84312d6bcc with identifier: 1980855 to the API
2026-03-24 16:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '09614916-6146-5c4d-8870-eb84312d6bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 32571,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09614916-6146-5c4d-8870-eb84312d6bcc/09614916-6146-5c4d-8870-eb84312d6bcc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/ad93d6d79e9141f38af9ca318db9a6e9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Business',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980855%27 HTTP/1.1" 200 None
2026-03-24 16:52:00 [ayvens.fr] INFO: Saving data for 1980855: {'created_time': 1774371120.573404, 'last_price_update_time': 1774371120.573414, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980855') HTTP/1.1" 204 0
2026-03-24 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83a90>
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/3.jpg saved to cache
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb9fd0>
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/4.jpg saved to cache
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc1090>
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/5.jpg saved to cache
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bffd90>
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/1.jpg saved to cache
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/4.jpg not downloaded yet
2026-03-24 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/5.jpg not downloaded yet
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4f890>
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/2.jpg saved to cache
2026-03-24 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b55550>
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/7.jpg saved to cache
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d30790>
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F20fd47b00df944d6a275c83b4f6fd9de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/8.jpg saved to cache
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78eab18d-74d8-5bc8-87c2-2d1870351e53
2026-03-24 16:52:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78eab18d-74d8-5bc8-87c2-2d1870351e53, skipping ID generation
2026-03-24 16:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78eab18d-74d8-5bc8-87c2-2d1870351e53 with scrape type 1
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78eab18d-74d8-5bc8-87c2-2d1870351e53 sending to next pipeline
2026-03-24 16:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 78eab18d-74d8-5bc8-87c2-2d1870351e53, identifier: 1980856
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf2f50>
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/5.jpg saved to cache
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 78eab18d-74d8-5bc8-87c2-2d1870351e53 with identifier: 1980856
2026-03-24 16:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 78eab18d-74d8-5bc8-87c2-2d1870351e53 with identifier: 1980856
2026-03-24 16:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 78eab18d-74d8-5bc8-87c2-2d1870351e53 with identifier: 1980856 to the API
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '78eab18d-74d8-5bc8-87c2-2d1870351e53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 83624,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eab18d-74d8-5bc8-87c2-2d1870351e53/78eab18d-74d8-5bc8-87c2-2d1870351e53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/20fd47b00df944d6a275c83b4f6fd9de/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid rechargeable 225ch Shine '
'Pack ë-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid rechargeable 225ch Shine Pack ë-EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980856%27 HTTP/1.1" 200 None
2026-03-24 16:52:01 [ayvens.fr] INFO: Saving data for 1980856: {'created_time': 1774371121.764579, 'last_price_update_time': 1774371121.764596, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980856') HTTP/1.1" 204 0
2026-03-24 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/6.jpg not downloaded yet
2026-03-24 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/7.jpg not downloaded yet
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d652d0>
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/1.jpg saved to cache
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc0250>
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/2.jpg saved to cache
2026-03-24 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c79b10>
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/3.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7df10>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/7.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/8.jpg not downloaded yet
2026-03-24 16:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:02 [ayvens.fr] INFO: Found listing with ID: 1980859
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980859%27 HTTP/1.1" 200 None
2026-03-24 16:52:02 [ayvens.fr] INFO: Scrape type for 1980859: 1
2026-03-24 16:52:02 [ayvens.fr] INFO: Extracting data for car ID: 1980859
2026-03-24 16:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7584654-24f1-5ede-9581-76368d8857a7 with identifier: 1980859
2026-03-24 16:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7584654-24f1-5ede-9581-76368d8857a7 with scrape type 1
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/1.jpg not downloaded yet
2026-03-24 16:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053350>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/6.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d050>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/4.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/2.jpg not downloaded yet
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/3.jpg not downloaded yet
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b3390>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb5891cb0341c426b87ece9e9a913c136%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/8.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f
2026-03-24 16:52:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de9d1126-cf23-54b9-ae5f-91c75dec9f6f, skipping ID generation
2026-03-24 16:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f with scrape type 1
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de9d1126-cf23-54b9-ae5f-91c75dec9f6f sending to next pipeline
2026-03-24 16:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: de9d1126-cf23-54b9-ae5f-91c75dec9f6f, identifier: 1980857
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7bd10>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/1.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f6850>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/2.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cac690>
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/3.jpg saved to cache
2026-03-24 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: de9d1126-cf23-54b9-ae5f-91c75dec9f6f with identifier: 1980857
2026-03-24 16:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: de9d1126-cf23-54b9-ae5f-91c75dec9f6f with identifier: 1980857
2026-03-24 16:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: de9d1126-cf23-54b9-ae5f-91c75dec9f6f with identifier: 1980857 to the API
2026-03-24 16:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'de9d1126-cf23-54b9-ae5f-91c75dec9f6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA2',
'odometer': 65087,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329709,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9d1126-cf23-54b9-ae5f-91c75dec9f6f/de9d1126-cf23-54b9-ae5f-91c75dec9f6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b5891cb0341c426b87ece9e9a913c136/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA2 Mazda 2 1.5 e-SKYACTIV G M Hybrid 90ch Elegance',
'transmission': 'manual',
'trim': 'Mazda 2 1.5 e-SKYACTIV G M Hybrid 90ch Elegance',
'vin': None,
'year': 2023}
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980857%27 HTTP/1.1" 200 None
2026-03-24 16:52:03 [ayvens.fr] INFO: Saving data for 1980857: {'created_time': 1774371123.670473, 'last_price_update_time': 1774371123.670486, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980857') HTTP/1.1" 204 0
2026-03-24 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/4.jpg not downloaded yet
2026-03-24 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/5.jpg not downloaded yet
2026-03-24 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3d090>
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/4.jpg saved to cache
2026-03-24 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/6.jpg not downloaded yet
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61251d0>
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/5.jpg saved to cache
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570f5d0>
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/6.jpg saved to cache
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/7.jpg not downloaded yet
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7db1210>
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/8.jpg saved to cache
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/8.jpg not downloaded yet
2026-03-24 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:04 [ayvens.fr] INFO: Found listing with ID: 1980860
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980860%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [ayvens.fr] INFO: Scrape type for 1980860: 1
2026-03-24 16:52:04 [ayvens.fr] INFO: Extracting data for car ID: 1980860
2026-03-24 16:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75b04b8-2c10-578d-9b3a-7512e05368a8 with identifier: 1980860
2026-03-24 16:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75b04b8-2c10-578d-9b3a-7512e05368a8 with scrape type 1
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/1.jpg not downloaded yet
2026-03-24 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/2.jpg not downloaded yet
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f6990>
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F72078d9fcac8482d9d5abdc1b81a0d22%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/7.jpg saved to cache
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72081f48-6e6a-5c85-be14-8ac97d910a22
2026-03-24 16:52:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72081f48-6e6a-5c85-be14-8ac97d910a22, skipping ID generation
2026-03-24 16:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72081f48-6e6a-5c85-be14-8ac97d910a22 with scrape type 1
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72081f48-6e6a-5c85-be14-8ac97d910a22 sending to next pipeline
2026-03-24 16:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 72081f48-6e6a-5c85-be14-8ac97d910a22, identifier: 1980858
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6bd90>
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/1.jpg saved to cache
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/3.jpg not downloaded yet
2026-03-24 16:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 72081f48-6e6a-5c85-be14-8ac97d910a22 with identifier: 1980858
2026-03-24 16:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 72081f48-6e6a-5c85-be14-8ac97d910a22 with identifier: 1980858
2026-03-24 16:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 72081f48-6e6a-5c85-be14-8ac97d910a22 with identifier: 1980858 to the API
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '72081f48-6e6a-5c85-be14-8ac97d910a22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 22222,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72081f48-6e6a-5c85-be14-8ac97d910a22/72081f48-6e6a-5c85-be14-8ac97d910a22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/72078d9fcac8482d9d5abdc1b81a0d22/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-21',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980858%27 HTTP/1.1" 200 None
2026-03-24 16:52:04 [ayvens.fr] INFO: Saving data for 1980858: {'created_time': 1774371124.999032, 'last_price_update_time': 1774371124.999044, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980858') HTTP/1.1" 204 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/4.jpg not downloaded yet
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60432d0>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/2.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad590>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/3.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6367110>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/4.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/5.jpg not downloaded yet
2026-03-24 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/6.jpg not downloaded yet
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/7.jpg not downloaded yet
2026-03-24 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/8.jpg not downloaded yet
2026-03-24 16:52:05 [ayvens.fr] INFO: Found listing with ID: 1980861
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980861%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [ayvens.fr] INFO: Scrape type for 1980861: 1
2026-03-24 16:52:05 [ayvens.fr] INFO: Extracting data for car ID: 1980861
2026-03-24 16:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcbb839-03f7-5f29-9656-5a23d524ebda with identifier: 1980861
2026-03-24 16:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcbb839-03f7-5f29-9656-5a23d524ebda with scrape type 1
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/1.jpg not downloaded yet
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/2.jpg not downloaded yet
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df84d0>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/5.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bbd90>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/7.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d85190>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/6.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/3.jpg not downloaded yet
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b1bd0>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fbc9cc8b31bfd4996ac21f5cdc37f5b82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/8.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7584654-24f1-5ede-9581-76368d8857a7
2026-03-24 16:52:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7584654-24f1-5ede-9581-76368d8857a7, skipping ID generation
2026-03-24 16:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7584654-24f1-5ede-9581-76368d8857a7 with scrape type 1
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7584654-24f1-5ede-9581-76368d8857a7 sending to next pipeline
2026-03-24 16:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e7584654-24f1-5ede-9581-76368d8857a7, identifier: 1980859
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bb190>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/2.jpg saved to cache
2026-03-24 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e30f10>
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/1.jpg saved to cache
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/4.jpg not downloaded yet
2026-03-24 16:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e7584654-24f1-5ede-9581-76368d8857a7 with identifier: 1980859
2026-03-24 16:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e7584654-24f1-5ede-9581-76368d8857a7 with identifier: 1980859
2026-03-24 16:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e7584654-24f1-5ede-9581-76368d8857a7 with identifier: 1980859 to the API
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'e7584654-24f1-5ede-9581-76368d8857a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 91989,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7584654-24f1-5ede-9581-76368d8857a7/e7584654-24f1-5ede-9581-76368d8857a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/bc9cc8b31bfd4996ac21f5cdc37f5b82/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980859%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [ayvens.fr] INFO: Saving data for 1980859: {'created_time': 1774371126.79877, 'last_price_update_time': 1774371126.798781, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980859') HTTP/1.1" 204 0
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -3 pages/min), scraped 251 items (at 37 items/min)
2026-03-24 16:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/5.jpg not downloaded yet
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/6.jpg not downloaded yet
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/7.jpg not downloaded yet
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/8.jpg not downloaded yet
2026-03-24 16:52:06 [ayvens.fr] INFO: Found listing with ID: 1980862
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980862%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [ayvens.fr] INFO: Scrape type for 1980862: 1
2026-03-24 16:52:06 [ayvens.fr] INFO: Extracting data for car ID: 1980862
2026-03-24 16:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65090cfc-2966-5b2c-8396-336e60c5d371 with identifier: 1980862
2026-03-24 16:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65090cfc-2966-5b2c-8396-336e60c5d371 with scrape type 1
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/1.jpg not downloaded yet
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/2.jpg not downloaded yet
2026-03-24 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcfc90>
2026-03-24 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/4.jpg saved to cache
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/3.jpg not downloaded yet
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/4.jpg not downloaded yet
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/5.jpg not downloaded yet
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708b90>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/3.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724050>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/6.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c56410>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/7.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56d8050>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/5.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c546d0>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Febfb464d728b40ea8384783b559472d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/8.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b75b04b8-2c10-578d-9b3a-7512e05368a8
2026-03-24 16:52:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b75b04b8-2c10-578d-9b3a-7512e05368a8, skipping ID generation
2026-03-24 16:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75b04b8-2c10-578d-9b3a-7512e05368a8 with scrape type 1
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b75b04b8-2c10-578d-9b3a-7512e05368a8 sending to next pipeline
2026-03-24 16:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b75b04b8-2c10-578d-9b3a-7512e05368a8, identifier: 1980860
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dcfdd0>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/1.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f9e50>
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/2.jpg saved to cache
2026-03-24 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b75b04b8-2c10-578d-9b3a-7512e05368a8 with identifier: 1980860
2026-03-24 16:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b75b04b8-2c10-578d-9b3a-7512e05368a8 with identifier: 1980860
2026-03-24 16:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b75b04b8-2c10-578d-9b3a-7512e05368a8 with identifier: 1980860 to the API
2026-03-24 16:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'b75b04b8-2c10-578d-9b3a-7512e05368a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 33934,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75b04b8-2c10-578d-9b3a-7512e05368a8/b75b04b8-2c10-578d-9b3a-7512e05368a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/ebfb464d728b40ea8384783b559472d4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2021}
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980860%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [ayvens.fr] INFO: Saving data for 1980860: {'created_time': 1774371128.353129, 'last_price_update_time': 1774371128.353141, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980860') HTTP/1.1" 204 0
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/6.jpg not downloaded yet
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/7.jpg not downloaded yet
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/8.jpg not downloaded yet
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [ayvens.fr] INFO: Found listing with ID: 1980863
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980863%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [ayvens.fr] INFO: Scrape type for 1980863: 1
2026-03-24 16:52:08 [ayvens.fr] INFO: Extracting data for car ID: 1980863
2026-03-24 16:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbedc40-9203-5edd-9eb2-f2382d5d7794 with identifier: 1980863
2026-03-24 16:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbedc40-9203-5edd-9eb2-f2382d5d7794 with scrape type 1
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/1.jpg not downloaded yet
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/2.jpg not downloaded yet
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/3.jpg not downloaded yet
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79ff590>
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/3.jpg saved to cache
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/4.jpg not downloaded yet
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbb990>
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/5.jpg saved to cache
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/5.jpg not downloaded yet
2026-03-24 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/6.jpg not downloaded yet
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b6790>
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/4.jpg saved to cache
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4556850>
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/7.jpg saved to cache
2026-03-24 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccd9d0>
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/6.jpg saved to cache
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84f10>
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/1.jpg saved to cache
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6096b90>
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/2.jpg saved to cache
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c70a90>
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F690f99e8927d4be9bf4e144a9b080b0b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/8.jpg saved to cache
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afcbb839-03f7-5f29-9656-5a23d524ebda
2026-03-24 16:52:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afcbb839-03f7-5f29-9656-5a23d524ebda, skipping ID generation
2026-03-24 16:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcbb839-03f7-5f29-9656-5a23d524ebda with scrape type 1
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afcbb839-03f7-5f29-9656-5a23d524ebda sending to next pipeline
2026-03-24 16:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: afcbb839-03f7-5f29-9656-5a23d524ebda, identifier: 1980861
2026-03-24 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: afcbb839-03f7-5f29-9656-5a23d524ebda with identifier: 1980861
2026-03-24 16:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: afcbb839-03f7-5f29-9656-5a23d524ebda with identifier: 1980861
2026-03-24 16:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: afcbb839-03f7-5f29-9656-5a23d524ebda with identifier: 1980861 to the API
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'afcbb839-03f7-5f29-9656-5a23d524ebda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 136033,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcbb839-03f7-5f29-9656-5a23d524ebda/afcbb839-03f7-5f29-9656-5a23d524ebda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/690f99e8927d4be9bf4e144a9b080b0b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980861%27 HTTP/1.1" 200 None
2026-03-24 16:52:09 [ayvens.fr] INFO: Saving data for 1980861: {'created_time': 1774371129.928291, 'last_price_update_time': 1774371129.928302, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980861') HTTP/1.1" 204 0
2026-03-24 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/7.jpg not downloaded yet
2026-03-24 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/8.jpg not downloaded yet
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5190>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/8.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60eef10>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/6.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d010>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/7.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d292d0>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/5.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:10 [ayvens.fr] INFO: Found listing with ID: 1980864
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980864%27 HTTP/1.1" 200 None
2026-03-24 16:52:10 [ayvens.fr] INFO: Scrape type for 1980864: 1
2026-03-24 16:52:10 [ayvens.fr] INFO: Extracting data for car ID: 1980864
2026-03-24 16:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9727e6-e835-5e71-bed9-4bcc51629931 with identifier: 1980864
2026-03-24 16:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9727e6-e835-5e71-bed9-4bcc51629931 with scrape type 1
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/1.jpg not downloaded yet
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/2.jpg not downloaded yet
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ded190>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/4.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd4b10>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa429949ab3448828a5753955e9089e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/3.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65090cfc-2966-5b2c-8396-336e60c5d371
2026-03-24 16:52:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65090cfc-2966-5b2c-8396-336e60c5d371, skipping ID generation
2026-03-24 16:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65090cfc-2966-5b2c-8396-336e60c5d371 with scrape type 1
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65090cfc-2966-5b2c-8396-336e60c5d371 sending to next pipeline
2026-03-24 16:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 65090cfc-2966-5b2c-8396-336e60c5d371, identifier: 1980862
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f57d0>
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/1.jpg saved to cache
2026-03-24 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 65090cfc-2966-5b2c-8396-336e60c5d371 with identifier: 1980862
2026-03-24 16:52:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 65090cfc-2966-5b2c-8396-336e60c5d371 with identifier: 1980862
2026-03-24 16:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 65090cfc-2966-5b2c-8396-336e60c5d371 with identifier: 1980862 to the API
2026-03-24 16:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.5L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '65090cfc-2966-5b2c-8396-336e60c5d371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 108835,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65090cfc-2966-5b2c-8396-336e60c5d371/65090cfc-2966-5b2c-8396-336e60c5d371_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa429949ab3448828a5753955e9089e9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Performance AWD',
'transmission': 'automatic',
'trim': 'Model Y Performance AWD',
'vin': None,
'year': 2022}
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980862%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [ayvens.fr] INFO: Saving data for 1980862: {'created_time': 1774371131.236234, 'last_price_update_time': 1774371131.236246, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980862') HTTP/1.1" 204 0
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/3.jpg not downloaded yet
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b77e10>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/2.jpg saved to cache
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/4.jpg not downloaded yet
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/5.jpg not downloaded yet
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f19d0>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/3.jpg saved to cache
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6367d50>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/5.jpg saved to cache
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/6.jpg not downloaded yet
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7ceee90>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/6.jpg saved to cache
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3fcd0>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/4.jpg saved to cache
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/7.jpg not downloaded yet
2026-03-24 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5caea50>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/7.jpg saved to cache
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/8.jpg not downloaded yet
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45560d0>
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F81caf9b4a9cc4a92a52db46a560085a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/8.jpg saved to cache
2026-03-24 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecbedc40-9203-5edd-9eb2-f2382d5d7794
2026-03-24 16:52:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecbedc40-9203-5edd-9eb2-f2382d5d7794, skipping ID generation
2026-03-24 16:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbedc40-9203-5edd-9eb2-f2382d5d7794 with scrape type 1
2026-03-24 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecbedc40-9203-5edd-9eb2-f2382d5d7794 sending to next pipeline
2026-03-24 16:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ecbedc40-9203-5edd-9eb2-f2382d5d7794, identifier: 1980863
2026-03-24 16:52:12 [ayvens.fr] INFO: Found listing with ID: 1980865
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980865%27 HTTP/1.1" 200 None
2026-03-24 16:52:12 [ayvens.fr] INFO: Scrape type for 1980865: 1
2026-03-24 16:52:12 [ayvens.fr] INFO: Extracting data for car ID: 1980865
2026-03-24 16:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d465fb6e-4095-5d58-959d-b6b09175e770 with identifier: 1980865
2026-03-24 16:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d465fb6e-4095-5d58-959d-b6b09175e770 with scrape type 1
2026-03-24 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/1.jpg not downloaded yet
2026-03-24 16:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ecbedc40-9203-5edd-9eb2-f2382d5d7794 with identifier: 1980863
2026-03-24 16:52:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ecbedc40-9203-5edd-9eb2-f2382d5d7794 with identifier: 1980863
2026-03-24 16:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ecbedc40-9203-5edd-9eb2-f2382d5d7794 with identifier: 1980863 to the API
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'NOIR INTENSE NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'ecbedc40-9203-5edd-9eb2-f2382d5d7794',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 87105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbedc40-9203-5edd-9eb2-f2382d5d7794/ecbedc40-9203-5edd-9eb2-f2382d5d7794_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/81caf9b4a9cc4a92a52db46a560085a9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 2.0 TDI SCR 115ch Life Business',
'transmission': 'manual',
'trim': 'Golf 2.0 TDI SCR 115ch Life Business',
'vin': None,
'year': 2023}
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980863%27 HTTP/1.1" 200 None
2026-03-24 16:52:12 [ayvens.fr] INFO: Saving data for 1980863: {'created_time': 1774371132.925213, 'last_price_update_time': 1774371132.925229, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980863') HTTP/1.1" 204 0
2026-03-24 16:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/2.jpg not downloaded yet
2026-03-24 16:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e07310>
2026-03-24 16:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/1.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/3.jpg not downloaded yet
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/4.jpg not downloaded yet
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6add0>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/3.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dec1d0>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/2.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/5.jpg not downloaded yet
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/6.jpg not downloaded yet
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6b010>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/4.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d55850>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/6.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b1990>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/5.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/7.jpg not downloaded yet
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/8.jpg not downloaded yet
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [ayvens.fr] INFO: Found listing with ID: 1980866
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980866%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [ayvens.fr] INFO: Scrape type for 1980866: 1
2026-03-24 16:52:13 [ayvens.fr] INFO: Extracting data for car ID: 1980866
2026-03-24 16:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe6bdb-50ca-5196-a631-35a2d5cd0007 with identifier: 1980866
2026-03-24 16:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007 with scrape type 1
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/1.jpg not downloaded yet
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/2.jpg not downloaded yet
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/3.jpg not downloaded yet
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/4.jpg not downloaded yet
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ee010>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/7.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/5.jpg not downloaded yet
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/6.jpg not downloaded yet
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/7.jpg not downloaded yet
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf00d0>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/2.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d490>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/1.jpg saved to cache
2026-03-24 16:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf49d0>
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Ff12a74b6972f4b97b47cc397e5456279%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/8.jpg saved to cache
2026-03-24 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f9727e6-e835-5e71-bed9-4bcc51629931
2026-03-24 16:52:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f9727e6-e835-5e71-bed9-4bcc51629931, skipping ID generation
2026-03-24 16:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9727e6-e835-5e71-bed9-4bcc51629931 with scrape type 1
2026-03-24 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f9727e6-e835-5e71-bed9-4bcc51629931 sending to next pipeline
2026-03-24 16:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4f9727e6-e835-5e71-bed9-4bcc51629931, identifier: 1980864
2026-03-24 16:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6199550>
2026-03-24 16:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/3.jpg saved to cache
2026-03-24 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4f9727e6-e835-5e71-bed9-4bcc51629931 with identifier: 1980864
2026-03-24 16:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4f9727e6-e835-5e71-bed9-4bcc51629931 with identifier: 1980864
2026-03-24 16:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4f9727e6-e835-5e71-bed9-4bcc51629931 with identifier: 1980864 to the API
2026-03-24 16:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '4f9727e6-e835-5e71-bed9-4bcc51629931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 55519,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9727e6-e835-5e71-bed9-4bcc51629931/4f9727e6-e835-5e71-bed9-4bcc51629931_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/f12a74b6972f4b97b47cc397e5456279/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.3 TCe mild hybrid 160ch Techno EDC',
'transmission': 'automatic',
'trim': 'Captur 1.3 TCe mild hybrid 160ch Techno EDC',
'vin': None,
'year': 2023}
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980864%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [ayvens.fr] INFO: Saving data for 1980864: {'created_time': 1774371136.028464, 'last_price_update_time': 1774371136.028478, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980864') HTTP/1.1" 204 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/8.jpg not downloaded yet
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [ayvens.fr] INFO: Found listing with ID: 1980867
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980867%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [ayvens.fr] INFO: Scrape type for 1980867: 1
2026-03-24 16:52:16 [ayvens.fr] INFO: Extracting data for car ID: 1980867
2026-03-24 16:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e609110-357b-5d08-9cee-68cda5ac28ff with identifier: 1980867
2026-03-24 16:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e609110-357b-5d08-9cee-68cda5ac28ff with scrape type 1
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/1.jpg not downloaded yet
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce13d0>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/7.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b9e50>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/8.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5deec50>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/4.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/2.jpg not downloaded yet
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/3.jpg not downloaded yet
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45ba290>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/2.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3c50>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/5.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfaf90>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/1.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5450>
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff97e4dc89e3f43bcb3947398dfa7bb36%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/6.jpg saved to cache
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d465fb6e-4095-5d58-959d-b6b09175e770
2026-03-24 16:52:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d465fb6e-4095-5d58-959d-b6b09175e770, skipping ID generation
2026-03-24 16:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d465fb6e-4095-5d58-959d-b6b09175e770 with scrape type 1
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d465fb6e-4095-5d58-959d-b6b09175e770 sending to next pipeline
2026-03-24 16:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d465fb6e-4095-5d58-959d-b6b09175e770, identifier: 1980865
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/4.jpg not downloaded yet
2026-03-24 16:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d465fb6e-4095-5d58-959d-b6b09175e770 with identifier: 1980865
2026-03-24 16:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d465fb6e-4095-5d58-959d-b6b09175e770 with identifier: 1980865
2026-03-24 16:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d465fb6e-4095-5d58-959d-b6b09175e770 with identifier: 1980865 to the API
2026-03-24 16:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd465fb6e-4095-5d58-959d-b6b09175e770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 43868,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329072,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d465fb6e-4095-5d58-959d-b6b09175e770/d465fb6e-4095-5d58-959d-b6b09175e770_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f97e4dc89e3f43bcb3947398dfa7bb36/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 2.5 Hybride 218ch Dynamic Business 2WD + '
'Programme Beyond Zero Academy',
'transmission': 'automatic',
'trim': 'RAV4 2.5 Hybride 218ch Dynamic Business 2WD + Programme Beyond Zero '
'Academy',
'vin': None,
'year': 2023}
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980865%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [ayvens.fr] INFO: Saving data for 1980865: {'created_time': 1774371137.462704, 'last_price_update_time': 1774371137.462715, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980865') HTTP/1.1" 204 0
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/5.jpg not downloaded yet
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfa190>
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/5.jpg saved to cache
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6041250>
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/3.jpg saved to cache
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6b110>
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/4.jpg saved to cache
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/6.jpg not downloaded yet
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d910>
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/6.jpg saved to cache
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7e061d0>
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/7.jpg saved to cache
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/7.jpg not downloaded yet
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/8.jpg not downloaded yet
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:17 [ayvens.fr] INFO: Found listing with ID: 1980868
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980868%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [ayvens.fr] INFO: Scrape type for 1980868: 1
2026-03-24 16:52:17 [ayvens.fr] INFO: Extracting data for car ID: 1980868
2026-03-24 16:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e37c80-7369-5be5-a082-deb9ba181416 with identifier: 1980868
2026-03-24 16:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e37c80-7369-5be5-a082-deb9ba181416 with scrape type 1
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/1.jpg not downloaded yet
2026-03-24 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/2.jpg not downloaded yet
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/3.jpg not downloaded yet
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/4.jpg not downloaded yet
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/5.jpg not downloaded yet
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621d610>
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/1.jpg saved to cache
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d29bd0>
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F74669dbdc6d6446fa3c66206c1de85b0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/8.jpg saved to cache
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007
2026-03-24 16:52:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47fe6bdb-50ca-5196-a631-35a2d5cd0007, skipping ID generation
2026-03-24 16:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007 with scrape type 1
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47fe6bdb-50ca-5196-a631-35a2d5cd0007 sending to next pipeline
2026-03-24 16:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 47fe6bdb-50ca-5196-a631-35a2d5cd0007, identifier: 1980866
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/6.jpg not downloaded yet
2026-03-24 16:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 47fe6bdb-50ca-5196-a631-35a2d5cd0007 with identifier: 1980866
2026-03-24 16:52:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 47fe6bdb-50ca-5196-a631-35a2d5cd0007 with identifier: 1980866
2026-03-24 16:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 47fe6bdb-50ca-5196-a631-35a2d5cd0007 with identifier: 1980866 to the API
2026-03-24 16:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'MINERALWEISS M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '47fe6bdb-50ca-5196-a631-35a2d5cd0007',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 42761,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47fe6bdb-50ca-5196-a631-35a2d5cd0007/47fe6bdb-50ca-5196-a631-35a2d5cd0007_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/74669dbdc6d6446fa3c66206c1de85b0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Série 1 118iA 136ch M Sport DKG7',
'transmission': 'automatic',
'trim': 'Série 1 118iA 136ch M Sport DKG7',
'vin': None,
'year': 2024}
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980866%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [ayvens.fr] INFO: Saving data for 1980866: {'created_time': 1774371139.244049, 'last_price_update_time': 1774371139.24406, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980866') HTTP/1.1" 204 0
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/7.jpg not downloaded yet
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456fdd0>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/3.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d73610>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/2.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e605bb50>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/4.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/8.jpg not downloaded yet
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [ayvens.fr] INFO: Found listing with ID: 1980869
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980869%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [ayvens.fr] INFO: Scrape type for 1980869: 1
2026-03-24 16:52:19 [ayvens.fr] INFO: Extracting data for car ID: 1980869
2026-03-24 16:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498a394c-ee20-5e78-8987-0ffa049da0e1 with identifier: 1980869
2026-03-24 16:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498a394c-ee20-5e78-8987-0ffa049da0e1 with scrape type 1
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/1.jpg not downloaded yet
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6a690>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/5.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/2.jpg not downloaded yet
2026-03-24 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/3.jpg not downloaded yet
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6bf90>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/7.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d08490>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/2.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6118750>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/6.jpg saved to cache
2026-03-24 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79ff5d0>
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/3.jpg saved to cache
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9110>
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/1.jpg saved to cache
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/4.jpg not downloaded yet
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/5.jpg not downloaded yet
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f2c90>
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F0bf48c90898d4d9fad2b45ca541cb04c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/8.jpg saved to cache
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e609110-357b-5d08-9cee-68cda5ac28ff
2026-03-24 16:52:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e609110-357b-5d08-9cee-68cda5ac28ff, skipping ID generation
2026-03-24 16:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e609110-357b-5d08-9cee-68cda5ac28ff with scrape type 1
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e609110-357b-5d08-9cee-68cda5ac28ff sending to next pipeline
2026-03-24 16:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2e609110-357b-5d08-9cee-68cda5ac28ff, identifier: 1980867
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8214090>
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/4.jpg saved to cache
2026-03-24 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2e609110-357b-5d08-9cee-68cda5ac28ff with identifier: 1980867
2026-03-24 16:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2e609110-357b-5d08-9cee-68cda5ac28ff with identifier: 1980867
2026-03-24 16:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2e609110-357b-5d08-9cee-68cda5ac28ff with identifier: 1980867 to the API
2026-03-24 16:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '2e609110-357b-5d08-9cee-68cda5ac28ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 69089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e609110-357b-5d08-9cee-68cda5ac28ff/2e609110-357b-5d08-9cee-68cda5ac28ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/0bf48c90898d4d9fad2b45ca541cb04c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-03',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'vin': None,
'year': 2022}
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980867%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [ayvens.fr] INFO: Saving data for 1980867: {'created_time': 1774371142.042368, 'last_price_update_time': 1774371142.042379, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980867') HTTP/1.1" 204 0
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/6.jpg not downloaded yet
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/7.jpg not downloaded yet
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/8.jpg not downloaded yet
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:22 [ayvens.fr] INFO: Found listing with ID: 1980870
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980870%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [ayvens.fr] INFO: Scrape type for 1980870: 1
2026-03-24 16:52:22 [ayvens.fr] INFO: Extracting data for car ID: 1980870
2026-03-24 16:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab5f7e28-55c2-53f7-b3d1-605befa32000 with identifier: 1980870
2026-03-24 16:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5f7e28-55c2-53f7-b3d1-605befa32000 with scrape type 1
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/1.jpg not downloaded yet
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/2.jpg not downloaded yet
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611a750>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/5.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708e10>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/7.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/3.jpg not downloaded yet
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c07150>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/6.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fffd0>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F960a5c0dbff74736b95acd9bf98a30e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/8.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5e37c80-7369-5be5-a082-deb9ba181416
2026-03-24 16:52:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5e37c80-7369-5be5-a082-deb9ba181416, skipping ID generation
2026-03-24 16:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e37c80-7369-5be5-a082-deb9ba181416 with scrape type 1
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5e37c80-7369-5be5-a082-deb9ba181416 sending to next pipeline
2026-03-24 16:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c5e37c80-7369-5be5-a082-deb9ba181416, identifier: 1980868
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4577890>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/1.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33e10>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/2.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccddd0>
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/3.jpg saved to cache
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/4.jpg not downloaded yet
2026-03-24 16:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c5e37c80-7369-5be5-a082-deb9ba181416 with identifier: 1980868
2026-03-24 16:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c5e37c80-7369-5be5-a082-deb9ba181416 with identifier: 1980868
2026-03-24 16:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c5e37c80-7369-5be5-a082-deb9ba181416 with identifier: 1980868 to the API
2026-03-24 16:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'c5e37c80-7369-5be5-a082-deb9ba181416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO',
'odometer': 22414,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e37c80-7369-5be5-a082-deb9ba181416/c5e37c80-7369-5be5-a082-deb9ba181416_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/960a5c0dbff74736b95acd9bf98a30e5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KANGOO Kangoo 1.3 TCe 130ch Techno',
'transmission': 'manual',
'trim': 'Kangoo 1.3 TCe 130ch Techno',
'vin': None,
'year': 2023}
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980868%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [ayvens.fr] INFO: Saving data for 1980868: {'created_time': 1774371145.147523, 'last_price_update_time': 1774371145.147534, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980868') HTTP/1.1" 204 0
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/5.jpg not downloaded yet
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/6.jpg not downloaded yet
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/7.jpg not downloaded yet
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/8.jpg not downloaded yet
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [ayvens.fr] INFO: Found listing with ID: 1980871
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980871%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [ayvens.fr] INFO: Scrape type for 1980871: 1
2026-03-24 16:52:25 [ayvens.fr] INFO: Extracting data for car ID: 1980871
2026-03-24 16:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2522a886-322b-53f8-a1b2-194febade51e with identifier: 1980871
2026-03-24 16:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2522a886-322b-53f8-a1b2-194febade51e with scrape type 1
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/1.jpg not downloaded yet
2026-03-24 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/2.jpg not downloaded yet
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56d55d0>
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/8.jpg saved to cache
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4557790>
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/4.jpg saved to cache
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f8110>
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/6.jpg saved to cache
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/3.jpg not downloaded yet
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3ea50>
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/5.jpg saved to cache
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61014d0>
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff56cbcb8a9c1412eb13395073ddcdd05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/7.jpg saved to cache
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 498a394c-ee20-5e78-8987-0ffa049da0e1
2026-03-24 16:52:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498a394c-ee20-5e78-8987-0ffa049da0e1, skipping ID generation
2026-03-24 16:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498a394c-ee20-5e78-8987-0ffa049da0e1 with scrape type 1
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498a394c-ee20-5e78-8987-0ffa049da0e1 sending to next pipeline
2026-03-24 16:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 498a394c-ee20-5e78-8987-0ffa049da0e1, identifier: 1980869
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/4.jpg not downloaded yet
2026-03-24 16:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 498a394c-ee20-5e78-8987-0ffa049da0e1 with identifier: 1980869
2026-03-24 16:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 498a394c-ee20-5e78-8987-0ffa049da0e1 with identifier: 1980869
2026-03-24 16:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 498a394c-ee20-5e78-8987-0ffa049da0e1 with identifier: 1980869 to the API
2026-03-24 16:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '498a394c-ee20-5e78-8987-0ffa049da0e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 39413,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a394c-ee20-5e78-8987-0ffa049da0e1/498a394c-ee20-5e78-8987-0ffa049da0e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250756,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f56cbcb8a9c1412eb13395073ddcdd05/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross PureTech 130ch S&S Feel',
'transmission': 'manual',
'trim': 'C5 Aircross PureTech 130ch S&S Feel',
'vin': None,
'year': 2023}
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980869%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [ayvens.fr] INFO: Saving data for 1980869: {'created_time': 1774371146.373266, 'last_price_update_time': 1774371146.373278, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980869') HTTP/1.1" 204 0
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/5.jpg not downloaded yet
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1a90>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/1.jpg saved to cache
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4557810>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/2.jpg saved to cache
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/6.jpg not downloaded yet
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/7.jpg not downloaded yet
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621cf10>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/7.jpg saved to cache
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/8.jpg not downloaded yet
2026-03-24 16:52:26 [ayvens.fr] INFO: Found listing with ID: 1980872
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980872%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [ayvens.fr] INFO: Scrape type for 1980872: 1
2026-03-24 16:52:26 [ayvens.fr] INFO: Extracting data for car ID: 1980872
2026-03-24 16:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9ee2fb0-93cb-5d67-b981-897d0606a71b with identifier: 1980872
2026-03-24 16:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9ee2fb0-93cb-5d67-b981-897d0606a71b with scrape type 1
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/1.jpg not downloaded yet
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/2.jpg not downloaded yet
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b549d0>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/6.jpg saved to cache
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c04350>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/4.jpg saved to cache
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfd7d0>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/5.jpg saved to cache
2026-03-24 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726010>
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/3.jpg saved to cache
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60aa810>
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F18d6ce2f4dcb4688b669d04d5a7d8aad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/8.jpg saved to cache
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab5f7e28-55c2-53f7-b3d1-605befa32000
2026-03-24 16:52:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab5f7e28-55c2-53f7-b3d1-605befa32000, skipping ID generation
2026-03-24 16:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5f7e28-55c2-53f7-b3d1-605befa32000 with scrape type 1
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab5f7e28-55c2-53f7-b3d1-605befa32000 sending to next pipeline
2026-03-24 16:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ab5f7e28-55c2-53f7-b3d1-605befa32000, identifier: 1980870
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7d8ee90>
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/1.jpg saved to cache
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/3.jpg not downloaded yet
2026-03-24 16:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ab5f7e28-55c2-53f7-b3d1-605befa32000 with identifier: 1980870
2026-03-24 16:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ab5f7e28-55c2-53f7-b3d1-605befa32000 with identifier: 1980870
2026-03-24 16:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ab5f7e28-55c2-53f7-b3d1-605befa32000 with identifier: 1980870 to the API
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'ab5f7e28-55c2-53f7-b3d1-605befa32000',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 29025,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5f7e28-55c2-53f7-b3d1-605befa32000/ab5f7e28-55c2-53f7-b3d1-605befa32000_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/18d6ce2f4dcb4688b669d04d5a7d8aad/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2024}
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980870%27 HTTP/1.1" 200 None
2026-03-24 16:52:27 [ayvens.fr] INFO: Saving data for 1980870: {'created_time': 1774371147.867962, 'last_price_update_time': 1774371147.867975, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980870') HTTP/1.1" 204 0
2026-03-24 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/4.jpg not downloaded yet
2026-03-24 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc82d0>
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/2.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/5.jpg not downloaded yet
2026-03-24 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/6.jpg not downloaded yet
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724210>
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/3.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf4150>
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/4.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/7.jpg not downloaded yet
2026-03-24 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/8.jpg not downloaded yet
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d86b50>
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/7.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb8a50>
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/8.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e19710>
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/6.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb9e50>
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fdee8be6a24d14231be8a6180c8f76f30%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/5.jpg saved to cache
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2522a886-322b-53f8-a1b2-194febade51e
2026-03-24 16:52:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2522a886-322b-53f8-a1b2-194febade51e, skipping ID generation
2026-03-24 16:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2522a886-322b-53f8-a1b2-194febade51e with scrape type 1
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2522a886-322b-53f8-a1b2-194febade51e sending to next pipeline
2026-03-24 16:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2522a886-322b-53f8-a1b2-194febade51e, identifier: 1980871
2026-03-24 16:52:28 [ayvens.fr] INFO: Found listing with ID: 1980873
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980873%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [ayvens.fr] INFO: Scrape type for 1980873: 1
2026-03-24 16:52:28 [ayvens.fr] INFO: Extracting data for car ID: 1980873
2026-03-24 16:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb4fce21-dded-5f5b-bf42-99b6ef20b7da with identifier: 1980873
2026-03-24 16:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da with scrape type 1
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/1.jpg not downloaded yet
2026-03-24 16:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2522a886-322b-53f8-a1b2-194febade51e with identifier: 1980871
2026-03-24 16:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2522a886-322b-53f8-a1b2-194febade51e with identifier: 1980871
2026-03-24 16:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2522a886-322b-53f8-a1b2-194febade51e with identifier: 1980871 to the API
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '2522a886-322b-53f8-a1b2-194febade51e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 125303,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2522a886-322b-53f8-a1b2-194febade51e/2522a886-322b-53f8-a1b2-194febade51e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/dee8be6a24d14231be8a6180c8f76f30/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-23',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT SCENIC Scenic 1.7 Blue dCi 120ch Business - 2 PLACES',
'transmission': 'manual',
'trim': 'Scenic 1.7 Blue dCi 120ch Business - 2 PLACES',
'vin': None,
'year': 2021}
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980871%27 HTTP/1.1" 200 None
2026-03-24 16:52:28 [ayvens.fr] INFO: Saving data for 1980871: {'created_time': 1774371148.979669, 'last_price_update_time': 1774371148.979681, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980871') HTTP/1.1" 204 0
2026-03-24 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/2.jpg not downloaded yet
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d33750>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/1.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/3.jpg not downloaded yet
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/4.jpg not downloaded yet
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bff50>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/2.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7c2d0>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/4.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/5.jpg not downloaded yet
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/6.jpg not downloaded yet
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87950>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/3.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e30e90>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/6.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613e5d0>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/5.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e316d0>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/7.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/7.jpg not downloaded yet
2026-03-24 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/8.jpg not downloaded yet
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570e6d0>
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fb648bb0f298745709d732e63027ae1c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/8.jpg saved to cache
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9ee2fb0-93cb-5d67-b981-897d0606a71b
2026-03-24 16:52:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9ee2fb0-93cb-5d67-b981-897d0606a71b, skipping ID generation
2026-03-24 16:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9ee2fb0-93cb-5d67-b981-897d0606a71b with scrape type 1
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9ee2fb0-93cb-5d67-b981-897d0606a71b sending to next pipeline
2026-03-24 16:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b9ee2fb0-93cb-5d67-b981-897d0606a71b, identifier: 1980872
2026-03-24 16:52:29 [ayvens.fr] INFO: Found listing with ID: 1980874
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980874%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [ayvens.fr] INFO: Scrape type for 1980874: 1
2026-03-24 16:52:29 [ayvens.fr] INFO: Extracting data for car ID: 1980874
2026-03-24 16:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b166905e-cf78-58ae-bebf-bf939d212a12 with identifier: 1980874
2026-03-24 16:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b166905e-cf78-58ae-bebf-bf939d212a12 with scrape type 1
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/1.jpg not downloaded yet
2026-03-24 16:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b9ee2fb0-93cb-5d67-b981-897d0606a71b with identifier: 1980872
2026-03-24 16:52:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b9ee2fb0-93cb-5d67-b981-897d0606a71b with identifier: 1980872
2026-03-24 16:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b9ee2fb0-93cb-5d67-b981-897d0606a71b with identifier: 1980872 to the API
2026-03-24 16:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'NOIR MYTHIC METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b9ee2fb0-93cb-5d67-b981-897d0606a71b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A4 AVANT',
'odometer': 53023,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ee2fb0-93cb-5d67-b981-897d0606a71b/b9ee2fb0-93cb-5d67-b981-897d0606a71b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/b648bb0f298745709d732e63027ae1c1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A4 AVANT A4 Avant 35 TFSI 150ch Business line S tronic 7',
'transmission': 'automatic',
'trim': 'A4 Avant 35 TFSI 150ch Business line S tronic 7',
'vin': None,
'year': 2021}
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980872%27 HTTP/1.1" 200 None
2026-03-24 16:52:30 [ayvens.fr] INFO: Saving data for 1980872: {'created_time': 1774371150.542532, 'last_price_update_time': 1774371150.542547, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980872') HTTP/1.1" 204 0
2026-03-24 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/2.jpg not downloaded yet
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8290>
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/1.jpg saved to cache
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/3.jpg not downloaded yet
2026-03-24 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/4.jpg not downloaded yet
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32690>
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/2.jpg saved to cache
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5e3d0>
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/3.jpg saved to cache
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87c10>
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/4.jpg saved to cache
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/5.jpg not downloaded yet
2026-03-24 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/6.jpg not downloaded yet
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d53f10>
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/5.jpg saved to cache
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1d590>
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/7.jpg saved to cache
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87810>
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/6.jpg saved to cache
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/7.jpg not downloaded yet
2026-03-24 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/8.jpg not downloaded yet
2026-03-24 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:31 [ayvens.fr] INFO: Found listing with ID: 1980875
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980875%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [ayvens.fr] INFO: Scrape type for 1980875: 1
2026-03-24 16:52:31 [ayvens.fr] INFO: Extracting data for car ID: 1980875
2026-03-24 16:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ff513f-d287-5191-b79b-8ac095474dc7 with identifier: 1980875
2026-03-24 16:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ff513f-d287-5191-b79b-8ac095474dc7 with scrape type 1
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/1.jpg not downloaded yet
2026-03-24 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/2.jpg not downloaded yet
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/3.jpg not downloaded yet
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/4.jpg not downloaded yet
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/5.jpg not downloaded yet
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e31c10>
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/1.jpg saved to cache
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3cd0>
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252Fd8d327153c8b4dcb961fe176c3452499%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/8.jpg saved to cache
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da
2026-03-24 16:52:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb4fce21-dded-5f5b-bf42-99b6ef20b7da, skipping ID generation
2026-03-24 16:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da with scrape type 1
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb4fce21-dded-5f5b-bf42-99b6ef20b7da sending to next pipeline
2026-03-24 16:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bb4fce21-dded-5f5b-bf42-99b6ef20b7da, identifier: 1980873
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bf6950>
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/2.jpg saved to cache
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/6.jpg not downloaded yet
2026-03-24 16:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bb4fce21-dded-5f5b-bf42-99b6ef20b7da with identifier: 1980873
2026-03-24 16:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bb4fce21-dded-5f5b-bf42-99b6ef20b7da with identifier: 1980873
2026-03-24 16:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bb4fce21-dded-5f5b-bf42-99b6ef20b7da with identifier: 1980873 to the API
2026-03-24 16:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'bb4fce21-dded-5f5b-bf42-99b6ef20b7da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 37084,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281826,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4fce21-dded-5f5b-bf42-99b6ef20b7da/bb4fce21-dded-5f5b-bf42-99b6ef20b7da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/d8d327153c8b4dcb961fe176c3452499/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PARTNER Partner Long 1.6 BlueHDi 100ch Cabine Approfondie '
'Pro',
'transmission': 'manual',
'trim': 'Partner Long 1.6 BlueHDi 100ch Cabine Approfondie Pro',
'vin': None,
'year': 2018}
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980873%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [ayvens.fr] INFO: Saving data for 1980873: {'created_time': 1774371152.21666, 'last_price_update_time': 1774371152.216676, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980873') HTTP/1.1" 204 0
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d85e90>
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/3.jpg saved to cache
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/7.jpg not downloaded yet
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d11f90>
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/4.jpg saved to cache
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/8.jpg not downloaded yet
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [ayvens.fr] INFO: Found listing with ID: 1980876
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980876%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [ayvens.fr] INFO: Scrape type for 1980876: 1
2026-03-24 16:52:32 [ayvens.fr] INFO: Extracting data for car ID: 1980876
2026-03-24 16:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 with identifier: 1980876
2026-03-24 16:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 with scrape type 1
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/1.jpg not downloaded yet
2026-03-24 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3bc50>
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/8.jpg saved to cache
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/2.jpg not downloaded yet
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/3.jpg not downloaded yet
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611a8d0>
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/5.jpg saved to cache
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6199310>
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/6.jpg saved to cache
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ecf10>
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F7c83161eb5524ff49fc9b54ae76ab33c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/7.jpg saved to cache
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b166905e-cf78-58ae-bebf-bf939d212a12
2026-03-24 16:52:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b166905e-cf78-58ae-bebf-bf939d212a12, skipping ID generation
2026-03-24 16:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b166905e-cf78-58ae-bebf-bf939d212a12 with scrape type 1
2026-03-24 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b166905e-cf78-58ae-bebf-bf939d212a12 sending to next pipeline
2026-03-24 16:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b166905e-cf78-58ae-bebf-bf939d212a12, identifier: 1980874
2026-03-24 16:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b166905e-cf78-58ae-bebf-bf939d212a12 with identifier: 1980874
2026-03-24 16:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b166905e-cf78-58ae-bebf-bf939d212a12 with identifier: 1980874
2026-03-24 16:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b166905e-cf78-58ae-bebf-bf939d212a12 with identifier: 1980874 to the API
2026-03-24 16:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b166905e-cf78-58ae-bebf-bf939d212a12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 87242,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b166905e-cf78-58ae-bebf-bf939d212a12/b166905e-cf78-58ae-bebf-bf939d212a12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/7c83161eb5524ff49fc9b54ae76ab33c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-14',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Extra '
'R-Link',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Extra R-Link',
'vin': None,
'year': 2021}
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980874%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [ayvens.fr] INFO: Saving data for 1980874: {'created_time': 1774371153.427967, 'last_price_update_time': 1774371153.42798, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980874') HTTP/1.1" 204 0
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/4.jpg not downloaded yet
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6235410>
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/2.jpg saved to cache
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613e350>
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/1.jpg saved to cache
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64d4750>
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/3.jpg saved to cache
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613d050>
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/4.jpg saved to cache
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/5.jpg not downloaded yet
2026-03-24 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/6.jpg not downloaded yet
2026-03-24 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/7.jpg not downloaded yet
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/8.jpg not downloaded yet
2026-03-24 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:33 [ayvens.fr] INFO: Found listing with ID: 1980877
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980877%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [ayvens.fr] INFO: Scrape type for 1980877: 1
2026-03-24 16:52:33 [ayvens.fr] INFO: Extracting data for car ID: 1980877
2026-03-24 16:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b8a567-0526-533e-b6dd-19c44ba10d62 with identifier: 1980877
2026-03-24 16:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b8a567-0526-533e-b6dd-19c44ba10d62 with scrape type 1
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/1.jpg not downloaded yet
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/2.jpg not downloaded yet
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/3.jpg not downloaded yet
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4576990>
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/5.jpg saved to cache
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad590>
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/6.jpg saved to cache
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7d510>
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/7.jpg saved to cache
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bac410>
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F19c76f2593e044e68b7fd05b40e1e22e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/8.jpg saved to cache
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19ff513f-d287-5191-b79b-8ac095474dc7
2026-03-24 16:52:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19ff513f-d287-5191-b79b-8ac095474dc7, skipping ID generation
2026-03-24 16:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ff513f-d287-5191-b79b-8ac095474dc7 with scrape type 1
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19ff513f-d287-5191-b79b-8ac095474dc7 sending to next pipeline
2026-03-24 16:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 19ff513f-d287-5191-b79b-8ac095474dc7, identifier: 1980875
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/4.jpg not downloaded yet
2026-03-24 16:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 19ff513f-d287-5191-b79b-8ac095474dc7 with identifier: 1980875
2026-03-24 16:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 19ff513f-d287-5191-b79b-8ac095474dc7 with identifier: 1980875
2026-03-24 16:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 19ff513f-d287-5191-b79b-8ac095474dc7 with identifier: 1980875 to the API
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'BLANC NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '19ff513f-d287-5191-b79b-8ac095474dc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 78573,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ff513f-d287-5191-b79b-8ac095474dc7/19ff513f-d287-5191-b79b-8ac095474dc7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/19c76f2593e044e68b7fd05b40e1e22e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross BlueHDi 130ch S&S Business EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980875%27 HTTP/1.1" 200 None
2026-03-24 16:52:34 [ayvens.fr] INFO: Saving data for 1980875: {'created_time': 1774371154.782299, 'last_price_update_time': 1774371154.782309, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980875') HTTP/1.1" 204 0
2026-03-24 16:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/5.jpg not downloaded yet
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5f890>
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/1.jpg saved to cache
2026-03-24 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddf490>
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/2.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/6.jpg not downloaded yet
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/7.jpg not downloaded yet
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32d10>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/5.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/8.jpg not downloaded yet
2026-03-24 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:35 [ayvens.fr] INFO: Found listing with ID: 1980878
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980878%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [ayvens.fr] INFO: Scrape type for 1980878: 1
2026-03-24 16:52:35 [ayvens.fr] INFO: Extracting data for car ID: 1980878
2026-03-24 16:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 with identifier: 1980878
2026-03-24 16:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 with scrape type 1
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/1.jpg not downloaded yet
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/2.jpg not downloaded yet
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dfb250>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/3.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f5e90>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/4.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d7d350>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/8.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8390>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/6.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/3.jpg not downloaded yet
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6095110>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F71609a27ed7b4deebedf99665b2c175f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/7.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7
2026-03-24 16:52:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7, skipping ID generation
2026-03-24 16:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 with scrape type 1
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 sending to next pipeline
2026-03-24 16:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7, identifier: 1980876
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e38890>
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/1.jpg saved to cache
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/4.jpg not downloaded yet
2026-03-24 16:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 with identifier: 1980876
2026-03-24 16:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 with identifier: 1980876
2026-03-24 16:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7 with identifier: 1980876 to the API
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'SAPHIR SCHWARZ METAL NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 83182,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416070,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416070,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7/4a6dcc2b-b60d-59f8-81a7-5a3b013bc4b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/71609a27ed7b4deebedf99665b2c175f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Série 1 118iA 136ch Business Design DKG7',
'transmission': 'automatic',
'trim': 'Série 1 118iA 136ch Business Design DKG7',
'vin': None,
'year': 2023}
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980876%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [ayvens.fr] INFO: Saving data for 1980876: {'created_time': 1774371156.366476, 'last_price_update_time': 1774371156.366492, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980876') HTTP/1.1" 204 0
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/5.jpg not downloaded yet
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b8250>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/2.jpg saved to cache
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/6.jpg not downloaded yet
2026-03-24 16:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/7.jpg not downloaded yet
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/8.jpg not downloaded yet
2026-03-24 16:52:36 [ayvens.fr] INFO: Found listing with ID: 1980879
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980879%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [ayvens.fr] INFO: Scrape type for 1980879: 1
2026-03-24 16:52:36 [ayvens.fr] INFO: Extracting data for car ID: 1980879
2026-03-24 16:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad30b717-4107-5020-be2d-4abaa8d92877 with identifier: 1980879
2026-03-24 16:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad30b717-4107-5020-be2d-4abaa8d92877 with scrape type 1
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/1.jpg not downloaded yet
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7b610>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/4.jpg saved to cache
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ddd450>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/5.jpg saved to cache
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6147f50>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/3.jpg saved to cache
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf0290>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/7.jpg saved to cache
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/2.jpg not downloaded yet
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/3.jpg not downloaded yet
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f9650>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/6.jpg saved to cache
2026-03-24 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fbe90>
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F0fa270bb84dc408698bb54aaabcd41dc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/8.jpg saved to cache
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40b8a567-0526-533e-b6dd-19c44ba10d62
2026-03-24 16:52:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40b8a567-0526-533e-b6dd-19c44ba10d62, skipping ID generation
2026-03-24 16:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b8a567-0526-533e-b6dd-19c44ba10d62 with scrape type 1
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40b8a567-0526-533e-b6dd-19c44ba10d62 sending to next pipeline
2026-03-24 16:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 40b8a567-0526-533e-b6dd-19c44ba10d62, identifier: 1980877
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce09d0>
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/1.jpg saved to cache
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 40b8a567-0526-533e-b6dd-19c44ba10d62 with identifier: 1980877
2026-03-24 16:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 40b8a567-0526-533e-b6dd-19c44ba10d62 with identifier: 1980877
2026-03-24 16:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 40b8a567-0526-533e-b6dd-19c44ba10d62 with identifier: 1980877 to the API
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'BLEU VERTIGO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '40b8a567-0526-533e-b6dd-19c44ba10d62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 127915,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252518,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b8a567-0526-533e-b6dd-19c44ba10d62/40b8a567-0526-533e-b6dd-19c44ba10d62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/0fa270bb84dc408698bb54aaabcd41dc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980877%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [ayvens.fr] INFO: Saving data for 1980877: {'created_time': 1774371157.549077, 'last_price_update_time': 1774371157.549092, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980877') HTTP/1.1" 204 0
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/4.jpg not downloaded yet
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/5.jpg not downloaded yet
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/6.jpg not downloaded yet
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/7.jpg not downloaded yet
2026-03-24 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/8.jpg not downloaded yet
2026-03-24 16:52:37 [ayvens.fr] INFO: Found listing with ID: 1980880
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980880%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [ayvens.fr] INFO: Scrape type for 1980880: 1
2026-03-24 16:52:37 [ayvens.fr] INFO: Extracting data for car ID: 1980880
2026-03-24 16:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c64c11a-88ba-5c47-bc6d-c7b337282304 with identifier: 1980880
2026-03-24 16:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c64c11a-88ba-5c47-bc6d-c7b337282304 with scrape type 1
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/1.jpg not downloaded yet
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/2.jpg not downloaded yet
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff650>
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/5.jpg saved to cache
2026-03-24 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cba810>
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/6.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d84fd0>
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/7.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc1010>
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/2.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/3.jpg not downloaded yet
2026-03-24 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/4.jpg not downloaded yet
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b75250>
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/4.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6367890>
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/3.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb9510>
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/1.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3390>
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fc66356094054475784ff351212980da5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/8.jpg saved to cache
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17
2026-03-24 16:52:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1531caad-2f30-5ffd-be7a-92b0e0ee3d17, skipping ID generation
2026-03-24 16:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 with scrape type 1
2026-03-24 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 sending to next pipeline
2026-03-24 16:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1531caad-2f30-5ffd-be7a-92b0e0ee3d17, identifier: 1980878
2026-03-24 16:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 with identifier: 1980878
2026-03-24 16:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 with identifier: 1980878
2026-03-24 16:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1531caad-2f30-5ffd-be7a-92b0e0ee3d17 with identifier: 1980878 to the API
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 222,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '1531caad-2f30-5ffd-be7a-92b0e0ee3d17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER PROPULSION',
'odometer': 103919,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482779,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330289,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1531caad-2f30-5ffd-be7a-92b0e0ee3d17/1531caad-2f30-5ffd-be7a-92b0e0ee3d17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/c66356094054475784ff351212980da5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-15',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER PROPULSION Master CCb R3500RJ L3 2.3 dCi 165ch '
'energy Confort EuroVI',
'transmission': 'manual',
'trim': 'Master CCb R3500RJ L3 2.3 dCi 165ch energy Confort EuroVI',
'vin': None,
'year': 2021}
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980878%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [ayvens.fr] INFO: Saving data for 1980878: {'created_time': 1774371159.086659, 'last_price_update_time': 1774371159.08667, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980878') HTTP/1.1" 204 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/5.jpg not downloaded yet
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/6.jpg not downloaded yet
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a2ad0>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/2.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/7.jpg not downloaded yet
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/8.jpg not downloaded yet
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a2750>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/3.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cee150>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/6.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a050>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/4.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f2750>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/7.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc6150>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/5.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:39 [ayvens.fr] INFO: Found listing with ID: 1980881
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980881%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [ayvens.fr] INFO: Scrape type for 1980881: 1
2026-03-24 16:52:39 [ayvens.fr] INFO: Extracting data for car ID: 1980881
2026-03-24 16:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f89905c-1cf7-51b5-ac4a-158302eadf9e with identifier: 1980881
2026-03-24 16:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e with scrape type 1
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/1.jpg not downloaded yet
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617ff50>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc13e68c8bac34a89b1eed3290747ca0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/8.jpg saved to cache
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad30b717-4107-5020-be2d-4abaa8d92877
2026-03-24 16:52:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad30b717-4107-5020-be2d-4abaa8d92877, skipping ID generation
2026-03-24 16:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad30b717-4107-5020-be2d-4abaa8d92877 with scrape type 1
2026-03-24 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad30b717-4107-5020-be2d-4abaa8d92877 sending to next pipeline
2026-03-24 16:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ad30b717-4107-5020-be2d-4abaa8d92877, identifier: 1980879
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d28650>
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/1.jpg saved to cache
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/2.jpg not downloaded yet
2026-03-24 16:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ad30b717-4107-5020-be2d-4abaa8d92877 with identifier: 1980879
2026-03-24 16:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ad30b717-4107-5020-be2d-4abaa8d92877 with identifier: 1980879
2026-03-24 16:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ad30b717-4107-5020-be2d-4abaa8d92877 with identifier: 1980879 to the API
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'ad30b717-4107-5020-be2d-4abaa8d92877',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 81763,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30b717-4107-5020-be2d-4abaa8d92877/ad30b717-4107-5020-be2d-4abaa8d92877_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c13e68c8bac34a89b1eed3290747ca0a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance Business',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance Business',
'vin': None,
'year': 2023}
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980879%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [ayvens.fr] INFO: Saving data for 1980879: {'created_time': 1774371160.436961, 'last_price_update_time': 1774371160.436972, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980879') HTTP/1.1" 204 0
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/3.jpg not downloaded yet
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c04350>
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/2.jpg saved to cache
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/4.jpg not downloaded yet
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/5.jpg not downloaded yet
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/6.jpg not downloaded yet
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/7.jpg not downloaded yet
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/8.jpg not downloaded yet
2026-03-24 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:40 [ayvens.fr] INFO: Found listing with ID: 1980882
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980882%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [ayvens.fr] INFO: Scrape type for 1980882: 1
2026-03-24 16:52:40 [ayvens.fr] INFO: Extracting data for car ID: 1980882
2026-03-24 16:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 355c76ff-0e4d-51ad-842a-06530bd67a6b with identifier: 1980882
2026-03-24 16:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 355c76ff-0e4d-51ad-842a-06530bd67a6b with scrape type 1
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/1.jpg not downloaded yet
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b7f510>
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/4.jpg saved to cache
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61451d0>
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/3.jpg saved to cache
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc3710>
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/6.jpg saved to cache
2026-03-24 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c686d0>
2026-03-24 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/5.jpg saved to cache
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/2.jpg not downloaded yet
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d85c90>
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/7.jpg saved to cache
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/3.jpg not downloaded yet
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/4.jpg not downloaded yet
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1c090>
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F4360ae36b4a9491f980e3f71a8170be2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/8.jpg saved to cache
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c64c11a-88ba-5c47-bc6d-c7b337282304
2026-03-24 16:52:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c64c11a-88ba-5c47-bc6d-c7b337282304, skipping ID generation
2026-03-24 16:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c64c11a-88ba-5c47-bc6d-c7b337282304 with scrape type 1
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c64c11a-88ba-5c47-bc6d-c7b337282304 sending to next pipeline
2026-03-24 16:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4c64c11a-88ba-5c47-bc6d-c7b337282304, identifier: 1980880
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4c64c11a-88ba-5c47-bc6d-c7b337282304 with identifier: 1980880
2026-03-24 16:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4c64c11a-88ba-5c47-bc6d-c7b337282304 with identifier: 1980880
2026-03-24 16:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4c64c11a-88ba-5c47-bc6d-c7b337282304 with identifier: 1980880 to the API
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '4c64c11a-88ba-5c47-bc6d-c7b337282304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 79885,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c64c11a-88ba-5c47-bc6d-c7b337282304/4c64c11a-88ba-5c47-bc6d-c7b337282304_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/4360ae36b4a9491f980e3f71a8170be2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 100ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '208 1.2 PureTech 100ch S&S GT EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980880%27 HTTP/1.1" 200 None
2026-03-24 16:52:41 [ayvens.fr] INFO: Saving data for 1980880: {'created_time': 1774371161.769111, 'last_price_update_time': 1774371161.769123, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980880') HTTP/1.1" 204 0
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/5.jpg not downloaded yet
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/6.jpg not downloaded yet
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc2890>
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/1.jpg saved to cache
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3e910>
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/7.jpg saved to cache
2026-03-24 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf36d0>
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/2.jpg saved to cache
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc8590>
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/4.jpg saved to cache
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/7.jpg not downloaded yet
2026-03-24 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/8.jpg not downloaded yet
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3ea90>
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/5.jpg saved to cache
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459d510>
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/6.jpg saved to cache
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f0350>
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/3.jpg saved to cache
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c0290>
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe53094eb731c404281684bff99d3dce0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/8.jpg saved to cache
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e
2026-03-24 16:52:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f89905c-1cf7-51b5-ac4a-158302eadf9e, skipping ID generation
2026-03-24 16:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e with scrape type 1
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f89905c-1cf7-51b5-ac4a-158302eadf9e sending to next pipeline
2026-03-24 16:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4f89905c-1cf7-51b5-ac4a-158302eadf9e, identifier: 1980881
2026-03-24 16:52:42 [ayvens.fr] INFO: Found listing with ID: 1980883
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980883%27 HTTP/1.1" 200 None
2026-03-24 16:52:42 [ayvens.fr] INFO: Scrape type for 1980883: 1
2026-03-24 16:52:42 [ayvens.fr] INFO: Extracting data for car ID: 1980883
2026-03-24 16:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5f1412-d6af-519e-a54e-521ff9c217cb with identifier: 1980883
2026-03-24 16:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5f1412-d6af-519e-a54e-521ff9c217cb with scrape type 1
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/1.jpg not downloaded yet
2026-03-24 16:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4f89905c-1cf7-51b5-ac4a-158302eadf9e with identifier: 1980881
2026-03-24 16:52:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4f89905c-1cf7-51b5-ac4a-158302eadf9e with identifier: 1980881
2026-03-24 16:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4f89905c-1cf7-51b5-ac4a-158302eadf9e with identifier: 1980881 to the API
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'NOIR ATTITUDE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '4f89905c-1cf7-51b5-ac4a-158302eadf9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 77737,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f89905c-1cf7-51b5-ac4a-158302eadf9e/4f89905c-1cf7-51b5-ac4a-158302eadf9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e53094eb731c404281684bff99d3dce0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 2.5 Hybride 218ch Dynamic Business 2WD + '
'Programme Beyond Zero Academy',
'transmission': 'automatic',
'trim': 'RAV4 2.5 Hybride 218ch Dynamic Business 2WD + Programme Beyond Zero '
'Academy',
'vin': None,
'year': 2023}
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980881%27 HTTP/1.1" 200 None
2026-03-24 16:52:42 [ayvens.fr] INFO: Saving data for 1980881: {'created_time': 1774371162.918824, 'last_price_update_time': 1774371162.918835, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980881') HTTP/1.1" 204 0
2026-03-24 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/2.jpg not downloaded yet
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a9010>
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/1.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6145b50>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/2.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/3.jpg not downloaded yet
2026-03-24 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce1d10>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/3.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6103c90>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/4.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/4.jpg not downloaded yet
2026-03-24 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/5.jpg not downloaded yet
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ded050>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/6.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bad9d0>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/5.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/6.jpg not downloaded yet
2026-03-24 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/7.jpg not downloaded yet
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e63668d0>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/7.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/8.jpg not downloaded yet
2026-03-24 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:43 [ayvens.fr] INFO: Found listing with ID: 1980884
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980884%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [ayvens.fr] INFO: Scrape type for 1980884: 1
2026-03-24 16:52:43 [ayvens.fr] INFO: Extracting data for car ID: 1980884
2026-03-24 16:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 with identifier: 1980884
2026-03-24 16:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 with scrape type 1
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/1.jpg not downloaded yet
2026-03-24 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4559210>
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3ad0bafd66ed4531a930b52cb96d6591%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/8.jpg saved to cache
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 355c76ff-0e4d-51ad-842a-06530bd67a6b
2026-03-24 16:52:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 355c76ff-0e4d-51ad-842a-06530bd67a6b, skipping ID generation
2026-03-24 16:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 355c76ff-0e4d-51ad-842a-06530bd67a6b with scrape type 1
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 355c76ff-0e4d-51ad-842a-06530bd67a6b sending to next pipeline
2026-03-24 16:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 355c76ff-0e4d-51ad-842a-06530bd67a6b, identifier: 1980882
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/2.jpg not downloaded yet
2026-03-24 16:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 355c76ff-0e4d-51ad-842a-06530bd67a6b with identifier: 1980882
2026-03-24 16:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 355c76ff-0e4d-51ad-842a-06530bd67a6b with identifier: 1980882
2026-03-24 16:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 355c76ff-0e4d-51ad-842a-06530bd67a6b with identifier: 1980882 to the API
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BOSSA NOVA WHITE',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '355c76ff-0e4d-51ad-842a-06530bd67a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 13048,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_355c76ff-0e4d-51ad-842a-06530bd67a6b/355c76ff-0e4d-51ad-842a-06530bd67a6b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3ad0bafd66ed4531a930b52cb96d6591/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-17',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Cult',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Cult',
'vin': None,
'year': 2022}
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980882%27 HTTP/1.1" 200 None
2026-03-24 16:52:44 [ayvens.fr] INFO: Saving data for 1980882: {'created_time': 1774371164.947314, 'last_price_update_time': 1774371164.947324, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980882') HTTP/1.1" 204 0
2026-03-24 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/3.jpg not downloaded yet
2026-03-24 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5caf350>
2026-03-24 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/1.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce09d0>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/2.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/4.jpg not downloaded yet
2026-03-24 16:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/5.jpg not downloaded yet
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d87990>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/3.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/6.jpg not downloaded yet
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e455bdd0>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/4.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e3b2d0>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/5.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3d950>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/6.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb82d0>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/7.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/7.jpg not downloaded yet
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/8.jpg not downloaded yet
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b628d0>
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc39e7f76b91c47eb9be4809d3c98a5a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/8.jpg saved to cache
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a5f1412-d6af-519e-a54e-521ff9c217cb
2026-03-24 16:52:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a5f1412-d6af-519e-a54e-521ff9c217cb, skipping ID generation
2026-03-24 16:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5f1412-d6af-519e-a54e-521ff9c217cb with scrape type 1
2026-03-24 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a5f1412-d6af-519e-a54e-521ff9c217cb sending to next pipeline
2026-03-24 16:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0a5f1412-d6af-519e-a54e-521ff9c217cb, identifier: 1980883
2026-03-24 16:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0a5f1412-d6af-519e-a54e-521ff9c217cb with identifier: 1980883
2026-03-24 16:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0a5f1412-d6af-519e-a54e-521ff9c217cb with identifier: 1980883
2026-03-24 16:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0a5f1412-d6af-519e-a54e-521ff9c217cb with identifier: 1980883 to the API
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '0a5f1412-d6af-519e-a54e-521ff9c217cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FIESTA',
'odometer': 110273,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a5f1412-d6af-519e-a54e-521ff9c217cb/0a5f1412-d6af-519e-a54e-521ff9c217cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c39e7f76b91c47eb9be4809d3c98a5a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-04',
'seats_number': 2,
'seller_name': None,
'title': 'FORD FIESTA Fiesta 1.5 TDCi 85ch Stop&Start Business Nav // 2 '
'PLACES - 2 SEATS',
'transmission': 'manual',
'trim': 'Fiesta 1.5 TDCi 85ch Stop&Start Business Nav // 2 PLACES - 2 SEATS',
'vin': None,
'year': 2019}
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980883%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [ayvens.fr] INFO: Saving data for 1980883: {'created_time': 1774371166.515649, 'last_price_update_time': 1774371166.515661, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980883') HTTP/1.1" 204 0
2026-03-24 16:52:46 [ayvens.fr] INFO: Found listing with ID: 1980885
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980885%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [ayvens.fr] INFO: Scrape type for 1980885: 1
2026-03-24 16:52:46 [ayvens.fr] INFO: Extracting data for car ID: 1980885
2026-03-24 16:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16301e2b-59e3-5253-a70e-dfad33c56eea with identifier: 1980885
2026-03-24 16:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16301e2b-59e3-5253-a70e-dfad33c56eea with scrape type 1
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/1.jpg not downloaded yet
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/2.jpg not downloaded yet
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/3.jpg not downloaded yet
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/4.jpg not downloaded yet
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/5.jpg not downloaded yet
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/6.jpg not downloaded yet
2026-03-24 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/7.jpg not downloaded yet
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/8.jpg not downloaded yet
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5719e50>
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/1.jpg saved to cache
2026-03-24 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df92d0>
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/2.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d3c810>
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/4.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [ayvens.fr] INFO: Found listing with ID: 1980886
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980886%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [ayvens.fr] INFO: Scrape type for 1980886: 1
2026-03-24 16:52:47 [ayvens.fr] INFO: Extracting data for car ID: 1980886
2026-03-24 16:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aecba20-a931-506f-94dd-ca0411b7c2c0 with identifier: 1980886
2026-03-24 16:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aecba20-a931-506f-94dd-ca0411b7c2c0 with scrape type 1
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/1.jpg not downloaded yet
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df9990>
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/3.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/2.jpg not downloaded yet
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/3.jpg not downloaded yet
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4559410>
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/6.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cce110>
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/5.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4f910>
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/7.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/4.jpg not downloaded yet
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/5.jpg not downloaded yet
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56bd7d0>
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fda0310e81a544283aea43da1cdf99387%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/8.jpg saved to cache
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1
2026-03-24 16:52:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c7ef7eb-0865-5123-a6f3-c2ee868462c1, skipping ID generation
2026-03-24 16:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 with scrape type 1
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 sending to next pipeline
2026-03-24 16:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3c7ef7eb-0865-5123-a6f3-c2ee868462c1, identifier: 1980884
2026-03-24 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/6.jpg not downloaded yet
2026-03-24 16:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 with identifier: 1980884
2026-03-24 16:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 with identifier: 1980884
2026-03-24 16:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3c7ef7eb-0865-5123-a6f3-c2ee868462c1 with identifier: 1980884 to the API
2026-03-24 16:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '3c7ef7eb-0865-5123-a6f3-c2ee868462c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 69755,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ef7eb-0865-5123-a6f3-c2ee868462c1/3c7ef7eb-0865-5123-a6f3-c2ee868462c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/da0310e81a544283aea43da1cdf99387/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross PureTech 130ch S&S Feel Pack',
'transmission': 'manual',
'trim': 'C5 Aircross PureTech 130ch S&S Feel Pack',
'vin': None,
'year': 2023}
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980884%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [ayvens.fr] INFO: Saving data for 1980884: {'created_time': 1774371168.134035, 'last_price_update_time': 1774371168.134051, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980884') HTTP/1.1" 204 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/7.jpg not downloaded yet
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bac510>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/4.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a04550>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/6.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4a10>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/3.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b3490>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/1.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570d510>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/2.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b61a10>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/5.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d616d0>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/7.jpg saved to cache
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/8.jpg not downloaded yet
2026-03-24 16:52:48 [ayvens.fr] INFO: Found listing with ID: 1980887
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980887%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [ayvens.fr] INFO: Scrape type for 1980887: 1
2026-03-24 16:52:48 [ayvens.fr] INFO: Extracting data for car ID: 1980887
2026-03-24 16:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c1f14d-ced2-5d4d-b871-d9d74d897540 with identifier: 1980887
2026-03-24 16:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c1f14d-ced2-5d4d-b871-d9d74d897540 with scrape type 1
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/1.jpg not downloaded yet
2026-03-24 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/2.jpg not downloaded yet
2026-03-24 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/3.jpg not downloaded yet
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/4.jpg not downloaded yet
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/5.jpg not downloaded yet
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/6.jpg not downloaded yet
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/7.jpg not downloaded yet
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/8.jpg not downloaded yet
2026-03-24 16:52:48 [ayvens.fr] INFO: Found listing with ID: 1980888
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980888%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [ayvens.fr] INFO: Scrape type for 1980888: 1
2026-03-24 16:52:48 [ayvens.fr] INFO: Extracting data for car ID: 1980888
2026-03-24 16:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c038643-5d01-57e3-a541-9c4efae7be47 with identifier: 1980888
2026-03-24 16:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c038643-5d01-57e3-a541-9c4efae7be47 with scrape type 1
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/1.jpg not downloaded yet
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60250>
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcbb754b634524faeaab0869be1441e78%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/8.jpg saved to cache
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16301e2b-59e3-5253-a70e-dfad33c56eea
2026-03-24 16:52:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16301e2b-59e3-5253-a70e-dfad33c56eea, skipping ID generation
2026-03-24 16:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16301e2b-59e3-5253-a70e-dfad33c56eea with scrape type 1
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16301e2b-59e3-5253-a70e-dfad33c56eea sending to next pipeline
2026-03-24 16:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 16301e2b-59e3-5253-a70e-dfad33c56eea, identifier: 1980885
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5d10>
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/2.jpg saved to cache
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456da10>
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/1.jpg saved to cache
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56cb450>
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/3.jpg saved to cache
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/2.jpg not downloaded yet
2026-03-24 16:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 16301e2b-59e3-5253-a70e-dfad33c56eea with identifier: 1980885
2026-03-24 16:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 16301e2b-59e3-5253-a70e-dfad33c56eea with identifier: 1980885
2026-03-24 16:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 16301e2b-59e3-5253-a70e-dfad33c56eea with identifier: 1980885 to the API
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '16301e2b-59e3-5253-a70e-dfad33c56eea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 137104,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375501,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16301e2b-59e3-5253-a70e-dfad33c56eea/16301e2b-59e3-5253-a70e-dfad33c56eea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cbb754b634524faeaab0869be1441e78/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-25',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980885%27 HTTP/1.1" 200 None
2026-03-24 16:52:49 [ayvens.fr] INFO: Saving data for 1980885: {'created_time': 1774371169.960952, 'last_price_update_time': 1774371169.96097, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980885') HTTP/1.1" 204 0
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56cbf90>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/4.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b7bd0>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/5.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/3.jpg not downloaded yet
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/4.jpg not downloaded yet
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc9750>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/7.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/5.jpg not downloaded yet
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/6.jpg not downloaded yet
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/7.jpg not downloaded yet
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/8.jpg not downloaded yet
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b54d50>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/6.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:50 [ayvens.fr] INFO: Found listing with ID: 1980889
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980889%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [ayvens.fr] INFO: Scrape type for 1980889: 1
2026-03-24 16:52:50 [ayvens.fr] INFO: Extracting data for car ID: 1980889
2026-03-24 16:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9f0a335-8b2f-5a39-9464-97a4c575c7c7 with identifier: 1980889
2026-03-24 16:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7 with scrape type 1
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/1.jpg not downloaded yet
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/2.jpg not downloaded yet
2026-03-24 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccd310>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/5.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f0f10>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/4.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60f9810>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/2.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e459d650>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/1.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60fafd0>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/3.jpg saved to cache
2026-03-24 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f2450>
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Ff3bc174dfe844b40938f8900ab2a6752%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/8.jpg saved to cache
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5aecba20-a931-506f-94dd-ca0411b7c2c0
2026-03-24 16:52:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5aecba20-a931-506f-94dd-ca0411b7c2c0, skipping ID generation
2026-03-24 16:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aecba20-a931-506f-94dd-ca0411b7c2c0 with scrape type 1
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5aecba20-a931-506f-94dd-ca0411b7c2c0 sending to next pipeline
2026-03-24 16:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5aecba20-a931-506f-94dd-ca0411b7c2c0, identifier: 1980886
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/3.jpg not downloaded yet
2026-03-24 16:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5aecba20-a931-506f-94dd-ca0411b7c2c0 with identifier: 1980886
2026-03-24 16:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5aecba20-a931-506f-94dd-ca0411b7c2c0 with identifier: 1980886
2026-03-24 16:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5aecba20-a931-506f-94dd-ca0411b7c2c0 with identifier: 1980886 to the API
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '5aecba20-a931-506f-94dd-ca0411b7c2c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 37085,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aecba20-a931-506f-94dd-ca0411b7c2c0/5aecba20-a931-506f-94dd-ca0411b7c2c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/f3bc174dfe844b40938f8900ab2a6752/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 110ch S&S Shine',
'vin': None,
'year': 2023}
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980886%27 HTTP/1.1" 200 None
2026-03-24 16:52:51 [ayvens.fr] INFO: Saving data for 1980886: {'created_time': 1774371171.495273, 'last_price_update_time': 1774371171.495285, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980886') HTTP/1.1" 204 0
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/4.jpg not downloaded yet
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e8306950>
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/6.jpg saved to cache
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d01590>
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/4.jpg saved to cache
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc12d0>
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/7.jpg saved to cache
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d61010>
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/1.jpg saved to cache
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/5.jpg not downloaded yet
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/6.jpg not downloaded yet
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8750>
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/3.jpg saved to cache
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b87310>
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/2.jpg saved to cache
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d54bd0>
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/5.jpg saved to cache
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/7.jpg not downloaded yet
2026-03-24 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/8.jpg not downloaded yet
2026-03-24 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68e90>
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/6.jpg saved to cache
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0f690>
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/7.jpg saved to cache
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:52 [ayvens.fr] INFO: Found listing with ID: 1980890
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980890%27 HTTP/1.1" 200 None
2026-03-24 16:52:52 [ayvens.fr] INFO: Scrape type for 1980890: 1
2026-03-24 16:52:52 [ayvens.fr] INFO: Extracting data for car ID: 1980890
2026-03-24 16:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97c256c-035a-5e46-beec-a86cc67b5add with identifier: 1980890
2026-03-24 16:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97c256c-035a-5e46-beec-a86cc67b5add with scrape type 1
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/1.jpg not downloaded yet
2026-03-24 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56d4a50>
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Ffb800adb5c8d4be394a467b3ac219c55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/8.jpg saved to cache
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87c1f14d-ced2-5d4d-b871-d9d74d897540
2026-03-24 16:52:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87c1f14d-ced2-5d4d-b871-d9d74d897540, skipping ID generation
2026-03-24 16:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c1f14d-ced2-5d4d-b871-d9d74d897540 with scrape type 1
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87c1f14d-ced2-5d4d-b871-d9d74d897540 sending to next pipeline
2026-03-24 16:52:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 87c1f14d-ced2-5d4d-b871-d9d74d897540, identifier: 1980887
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/2.jpg not downloaded yet
2026-03-24 16:52:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 87c1f14d-ced2-5d4d-b871-d9d74d897540 with identifier: 1980887
2026-03-24 16:52:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 87c1f14d-ced2-5d4d-b871-d9d74d897540 with identifier: 1980887
2026-03-24 16:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 87c1f14d-ced2-5d4d-b871-d9d74d897540 with identifier: 1980887 to the API
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 92,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '87c1f14d-ced2-5d4d-b871-d9d74d897540',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 CACTUS',
'odometer': 99635,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410693,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410693,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c1f14d-ced2-5d4d-b871-d9d74d897540/87c1f14d-ced2-5d4d-b871-d9d74d897540_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474268,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/fb800adb5c8d4be394a467b3ac219c55/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C4 CACTUS C4 Cactus Ste 1.6 BlueHDi 100 S&S Feel Nav',
'transmission': 'manual',
'trim': 'C4 Cactus Ste 1.6 BlueHDi 100 S&S Feel Nav',
'vin': None,
'year': 2019}
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980887%27 HTTP/1.1" 200 None
2026-03-24 16:52:52 [ayvens.fr] INFO: Saving data for 1980887: {'created_time': 1774371172.95308, 'last_price_update_time': 1774371172.953092, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980887') HTTP/1.1" 204 0
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6053d50>
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff1f3032782b745f882dfbb3dcc00fcff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/8.jpg saved to cache
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c038643-5d01-57e3-a541-9c4efae7be47
2026-03-24 16:52:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c038643-5d01-57e3-a541-9c4efae7be47, skipping ID generation
2026-03-24 16:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c038643-5d01-57e3-a541-9c4efae7be47 with scrape type 1
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c038643-5d01-57e3-a541-9c4efae7be47 sending to next pipeline
2026-03-24 16:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9c038643-5d01-57e3-a541-9c4efae7be47, identifier: 1980888
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6bd90>
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/2.jpg saved to cache
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6366290>
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/1.jpg saved to cache
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/3.jpg not downloaded yet
2026-03-24 16:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9c038643-5d01-57e3-a541-9c4efae7be47 with identifier: 1980888
2026-03-24 16:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9c038643-5d01-57e3-a541-9c4efae7be47 with identifier: 1980888
2026-03-24 16:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9c038643-5d01-57e3-a541-9c4efae7be47 with identifier: 1980888 to the API
2026-03-24 16:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '9c038643-5d01-57e3-a541-9c4efae7be47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 79870,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c038643-5d01-57e3-a541-9c4efae7be47/9c038643-5d01-57e3-a541-9c4efae7be47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381650,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f1f3032782b745f882dfbb3dcc00fcff/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 220ch Equilibre '
'optimum charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 220ch Equilibre optimum charge',
'vin': None,
'year': 2022}
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980888%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [ayvens.fr] INFO: Saving data for 1980888: {'created_time': 1774371174.447296, 'last_price_update_time': 1774371174.447313, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980888') HTTP/1.1" 204 0
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4e310>
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/3.jpg saved to cache
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c80090>
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/4.jpg saved to cache
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/4.jpg not downloaded yet
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/5.jpg not downloaded yet
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e18f50>
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/5.jpg saved to cache
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6146d10>
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/6.jpg saved to cache
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/6.jpg not downloaded yet
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e04b90>
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/8.jpg saved to cache
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/7.jpg not downloaded yet
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/8.jpg not downloaded yet
2026-03-24 16:52:54 [ayvens.fr] INFO: Found listing with ID: 1980891
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980891%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [ayvens.fr] INFO: Scrape type for 1980891: 1
2026-03-24 16:52:54 [ayvens.fr] INFO: Extracting data for car ID: 1980891
2026-03-24 16:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37faecc-719f-5951-bb56-22ee7d8ff33d with identifier: 1980891
2026-03-24 16:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37faecc-719f-5951-bb56-22ee7d8ff33d with scrape type 1
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/1.jpg not downloaded yet
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/2.jpg not downloaded yet
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c88250>
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1d0871959fc04e98a4625890160a6feb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/7.jpg saved to cache
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7
2026-03-24 16:52:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9f0a335-8b2f-5a39-9464-97a4c575c7c7, skipping ID generation
2026-03-24 16:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7 with scrape type 1
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9f0a335-8b2f-5a39-9464-97a4c575c7c7 sending to next pipeline
2026-03-24 16:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a9f0a335-8b2f-5a39-9464-97a4c575c7c7, identifier: 1980889
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613c910>
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/1.jpg saved to cache
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/3.jpg not downloaded yet
2026-03-24 16:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a9f0a335-8b2f-5a39-9464-97a4c575c7c7 with identifier: 1980889
2026-03-24 16:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a9f0a335-8b2f-5a39-9464-97a4c575c7c7 with identifier: 1980889
2026-03-24 16:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a9f0a335-8b2f-5a39-9464-97a4c575c7c7 with identifier: 1980889 to the API
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'a9f0a335-8b2f-5a39-9464-97a4c575c7c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 60033,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314217,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f0a335-8b2f-5a39-9464-97a4c575c7c7/a9f0a335-8b2f-5a39-9464-97a4c575c7c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1d0871959fc04e98a4625890160a6feb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Sté 1.0 TCe 90ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Sté 1.0 TCe 90ch Air Nav',
'vin': None,
'year': 2021}
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980889%27 HTTP/1.1" 200 None
2026-03-24 16:52:55 [ayvens.fr] INFO: Saving data for 1980889: {'created_time': 1774371175.578443, 'last_price_update_time': 1774371175.578454, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980889') HTTP/1.1" 204 0
2026-03-24 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/4.jpg not downloaded yet
2026-03-24 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613d5d0>
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/2.jpg saved to cache
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b62d0>
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/3.jpg saved to cache
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/5.jpg not downloaded yet
2026-03-24 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/6.jpg not downloaded yet
2026-03-24 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e077d0>
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/4.jpg saved to cache
2026-03-24 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b859d0>
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/6.jpg saved to cache
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d04d0>
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/7.jpg saved to cache
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/7.jpg not downloaded yet
2026-03-24 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/8.jpg not downloaded yet
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f5a9b590>
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/5.jpg saved to cache
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613d790>
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F03eccebcb55b492ca6a422a13a15b888%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/8.jpg saved to cache
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b97c256c-035a-5e46-beec-a86cc67b5add
2026-03-24 16:52:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b97c256c-035a-5e46-beec-a86cc67b5add, skipping ID generation
2026-03-24 16:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97c256c-035a-5e46-beec-a86cc67b5add with scrape type 1
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b97c256c-035a-5e46-beec-a86cc67b5add sending to next pipeline
2026-03-24 16:52:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b97c256c-035a-5e46-beec-a86cc67b5add, identifier: 1980890
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c04f50>
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/1.jpg saved to cache
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:56 [ayvens.fr] INFO: Found listing with ID: 1980892
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980892%27 HTTP/1.1" 200 None
2026-03-24 16:52:56 [ayvens.fr] INFO: Scrape type for 1980892: 1
2026-03-24 16:52:56 [ayvens.fr] INFO: Extracting data for car ID: 1980892
2026-03-24 16:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f99ede1-978d-5054-9a75-5849b62ace65 with identifier: 1980892
2026-03-24 16:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f99ede1-978d-5054-9a75-5849b62ace65 with scrape type 1
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/1.jpg not downloaded yet
2026-03-24 16:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b97c256c-035a-5e46-beec-a86cc67b5add with identifier: 1980890
2026-03-24 16:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b97c256c-035a-5e46-beec-a86cc67b5add with identifier: 1980890
2026-03-24 16:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b97c256c-035a-5e46-beec-a86cc67b5add with identifier: 1980890 to the API
2026-03-24 16:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'b97c256c-035a-5e46-beec-a86cc67b5add',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 CACTUS',
'odometer': 87016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b97c256c-035a-5e46-beec-a86cc67b5add/b97c256c-035a-5e46-beec-a86cc67b5add_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/03eccebcb55b492ca6a422a13a15b888/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-05',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C4 CACTUS C4 Cactus Ste 1.5 BlueHDi 120 S&S Feel Nav EAT6',
'transmission': 'automatic',
'trim': 'C4 Cactus Ste 1.5 BlueHDi 120 S&S Feel Nav EAT6',
'vin': None,
'year': 2020}
2026-03-24 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980890%27 HTTP/1.1" 200 None
2026-03-24 16:52:57 [ayvens.fr] INFO: Saving data for 1980890: {'created_time': 1774371177.963111, 'last_price_update_time': 1774371177.963128, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980890') HTTP/1.1" 204 0
2026-03-24 16:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/2.jpg not downloaded yet
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45bbbd0>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/2.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/3.jpg not downloaded yet
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/4.jpg not downloaded yet
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccec10>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/3.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4576f90>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/4.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/5.jpg not downloaded yet
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/6.jpg not downloaded yet
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ec690>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/6.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629e210>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/7.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f7dd0>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/5.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/7.jpg not downloaded yet
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/8.jpg not downloaded yet
2026-03-24 16:52:58 [ayvens.fr] INFO: Found listing with ID: 1980893
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980893%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [ayvens.fr] INFO: Scrape type for 1980893: 1
2026-03-24 16:52:58 [ayvens.fr] INFO: Extracting data for car ID: 1980893
2026-03-24 16:52:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 with identifier: 1980893
2026-03-24 16:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 with scrape type 1
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/1.jpg not downloaded yet
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/2.jpg not downloaded yet
2026-03-24 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/3.jpg not downloaded yet
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/4.jpg not downloaded yet
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ca7cd0>
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F662bb6e02dc5413d9e6efdca4968aef1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/8.jpg saved to cache
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d37faecc-719f-5951-bb56-22ee7d8ff33d
2026-03-24 16:52:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d37faecc-719f-5951-bb56-22ee7d8ff33d, skipping ID generation
2026-03-24 16:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37faecc-719f-5951-bb56-22ee7d8ff33d with scrape type 1
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d37faecc-719f-5951-bb56-22ee7d8ff33d sending to next pipeline
2026-03-24 16:52:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d37faecc-719f-5951-bb56-22ee7d8ff33d, identifier: 1980891
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/5.jpg not downloaded yet
2026-03-24 16:52:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d37faecc-719f-5951-bb56-22ee7d8ff33d with identifier: 1980891
2026-03-24 16:52:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d37faecc-719f-5951-bb56-22ee7d8ff33d with identifier: 1980891
2026-03-24 16:52:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d37faecc-719f-5951-bb56-22ee7d8ff33d with identifier: 1980891 to the API
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'd37faecc-719f-5951-bb56-22ee7d8ff33d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 CACTUS',
'odometer': 107462,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d37faecc-719f-5951-bb56-22ee7d8ff33d/d37faecc-719f-5951-bb56-22ee7d8ff33d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/662bb6e02dc5413d9e6efdca4968aef1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-05',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C4 CACTUS C4 Cactus Ste 1.5 BlueHDi 120 S&S Feel Nav EAT6',
'transmission': 'automatic',
'trim': 'C4 Cactus Ste 1.5 BlueHDi 120 S&S Feel Nav EAT6',
'vin': None,
'year': 2020}
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980891%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [ayvens.fr] INFO: Saving data for 1980891: {'created_time': 1774371179.049052, 'last_price_update_time': 1774371179.049064, 'auction_closing_time': 1774605600.0}
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980891') HTTP/1.1" 204 0
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/6.jpg not downloaded yet
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/7.jpg not downloaded yet
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b87f90>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/1.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613cc50>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/4.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56f02d0>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/2.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/8.jpg not downloaded yet
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [ayvens.fr] INFO: Found listing with ID: 1980894
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980894%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [ayvens.fr] INFO: Scrape type for 1980894: 1
2026-03-24 16:52:59 [ayvens.fr] INFO: Extracting data for car ID: 1980894
2026-03-24 16:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75ce47e-da74-5cbe-98da-777de52c6801 with identifier: 1980894
2026-03-24 16:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75ce47e-da74-5cbe-98da-777de52c6801 with scrape type 1
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/1.jpg not downloaded yet
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c83a90>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/3.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6125510>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/5.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/2.jpg not downloaded yet
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/3.jpg not downloaded yet
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6051510>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/6.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621cfd0>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/8.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621eb50>
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F6c8e5c8752ca445f8ca7977f5fe81e48%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/7.jpg saved to cache
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f99ede1-978d-5054-9a75-5849b62ace65
2026-03-24 16:52:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f99ede1-978d-5054-9a75-5849b62ace65, skipping ID generation
2026-03-24 16:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f99ede1-978d-5054-9a75-5849b62ace65 with scrape type 1
2026-03-24 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f99ede1-978d-5054-9a75-5849b62ace65 sending to next pipeline
2026-03-24 16:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7f99ede1-978d-5054-9a75-5849b62ace65, identifier: 1980892
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b75d0>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/2.jpg saved to cache
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccfcd0>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/3.jpg saved to cache
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45588d0>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/1.jpg saved to cache
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7f99ede1-978d-5054-9a75-5849b62ace65 with identifier: 1980892
2026-03-24 16:53:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7f99ede1-978d-5054-9a75-5849b62ace65 with identifier: 1980892
2026-03-24 16:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7f99ede1-978d-5054-9a75-5849b62ace65 with identifier: 1980892 to the API
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'BLEU DENIM METALISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '7f99ede1-978d-5054-9a75-5849b62ace65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA TS',
'odometer': 136598,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f99ede1-978d-5054-9a75-5849b62ace65/7f99ede1-978d-5054-9a75-5849b62ace65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/6c8e5c8752ca445f8ca7977f5fe81e48/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA TS Corolla Touring Spt 122h Dynamic Business + Stage '
'Hybrid Academy',
'transmission': 'automatic',
'trim': 'Corolla Touring Spt 122h Dynamic Business + Stage Hybrid Academy',
'vin': None,
'year': 2021}
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980892%27 HTTP/1.1" 200 None
2026-03-24 16:53:00 [ayvens.fr] INFO: Saving data for 1980892: {'created_time': 1774371180.664643, 'last_price_update_time': 1774371180.664656, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980892') HTTP/1.1" 204 0
2026-03-24 16:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/4.jpg not downloaded yet
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6a990>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/4.jpg saved to cache
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/5.jpg not downloaded yet
2026-03-24 16:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/6.jpg not downloaded yet
2026-03-24 16:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56a5790>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/5.jpg saved to cache
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/7.jpg not downloaded yet
2026-03-24 16:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/8.jpg not downloaded yet
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf1090>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/8.jpg saved to cache
2026-03-24 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d28750>
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/7.jpg saved to cache
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:01 [ayvens.fr] INFO: Found listing with ID: 1980895
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980895%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [ayvens.fr] INFO: Scrape type for 1980895: 1
2026-03-24 16:53:01 [ayvens.fr] INFO: Extracting data for car ID: 1980895
2026-03-24 16:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26c7c9b-9987-58cb-8234-c30e1ae2e884 with identifier: 1980895
2026-03-24 16:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26c7c9b-9987-58cb-8234-c30e1ae2e884 with scrape type 1
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/1.jpg not downloaded yet
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ca7cd0>
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F5811f61bc01543219cb406cc25c824f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/6.jpg saved to cache
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958
2026-03-24 16:53:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c2594bf-a0bb-5d3f-9485-7e6d57e10958, skipping ID generation
2026-03-24 16:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 with scrape type 1
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 sending to next pipeline
2026-03-24 16:53:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3c2594bf-a0bb-5d3f-9485-7e6d57e10958, identifier: 1980893
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/2.jpg not downloaded yet
2026-03-24 16:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 with identifier: 1980893
2026-03-24 16:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 with identifier: 1980893
2026-03-24 16:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3c2594bf-a0bb-5d3f-9485-7e6d57e10958 with identifier: 1980893 to the API
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'electric',
'id': '3c2594bf-a0bb-5d3f-9485-7e6d57e10958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'EV6',
'odometer': 124586,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2594bf-a0bb-5d3f-9485-7e6d57e10958/3c2594bf-a0bb-5d3f-9485-7e6d57e10958_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/5811f61bc01543219cb406cc25c824f9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'KIA EV6 EV6 229ch Air Design 2WD',
'transmission': 'automatic',
'trim': 'EV6 229ch Air Design 2WD',
'vin': None,
'year': 2023}
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980893%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [ayvens.fr] INFO: Saving data for 1980893: {'created_time': 1774371181.718384, 'last_price_update_time': 1774371181.718397, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980893') HTTP/1.1" 204 0
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1d7d0>
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/1.jpg saved to cache
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/3.jpg not downloaded yet
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/4.jpg not downloaded yet
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/5.jpg not downloaded yet
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/6.jpg not downloaded yet
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/7.jpg not downloaded yet
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/8.jpg not downloaded yet
2026-03-24 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:01 [ayvens.fr] INFO: Found listing with ID: 1980896
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980896%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [ayvens.fr] INFO: Scrape type for 1980896: 1
2026-03-24 16:53:01 [ayvens.fr] INFO: Extracting data for car ID: 1980896
2026-03-24 16:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 669428f4-10f1-5e78-9432-65517dfd5cf2 with identifier: 1980896
2026-03-24 16:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669428f4-10f1-5e78-9432-65517dfd5cf2 with scrape type 1
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/1.jpg not downloaded yet
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/2.jpg not downloaded yet
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/3.jpg not downloaded yet
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb9c10>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/3.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4dad0>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/6.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d06d0>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/4.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e621e290>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/5.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2810>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/7.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5df8cd0>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/2.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/4.jpg not downloaded yet
2026-03-24 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/5.jpg not downloaded yet
2026-03-24 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da7490>
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Feq-%252F05c9d7c324264d8394613f3c0436cc7a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/8.jpg saved to cache
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d75ce47e-da74-5cbe-98da-777de52c6801
2026-03-24 16:53:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d75ce47e-da74-5cbe-98da-777de52c6801, skipping ID generation
2026-03-24 16:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75ce47e-da74-5cbe-98da-777de52c6801 with scrape type 1
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d75ce47e-da74-5cbe-98da-777de52c6801 sending to next pipeline
2026-03-24 16:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d75ce47e-da74-5cbe-98da-777de52c6801, identifier: 1980894
2026-03-24 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/6.jpg not downloaded yet
2026-03-24 16:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d75ce47e-da74-5cbe-98da-777de52c6801 with identifier: 1980894
2026-03-24 16:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d75ce47e-da74-5cbe-98da-777de52c6801 with identifier: 1980894
2026-03-24 16:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d75ce47e-da74-5cbe-98da-777de52c6801 with identifier: 1980894 to the API
2026-03-24 16:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'd75ce47e-da74-5cbe-98da-777de52c6801',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 58949,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75ce47e-da74-5cbe-98da-777de52c6801/d75ce47e-da74-5cbe-98da-777de52c6801_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/eq-/05c9d7c324264d8394613f3c0436cc7a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-21',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT PARTNER Partner Standard 1.6 BlueHDi 100ch S&S Premium Pack '
'ETG6',
'transmission': 'automatic',
'trim': 'Partner Standard 1.6 BlueHDi 100ch S&S Premium Pack ETG6',
'vin': None,
'year': 2017}
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980894%27 HTTP/1.1" 200 None
2026-03-24 16:53:03 [ayvens.fr] INFO: Saving data for 1980894: {'created_time': 1774371183.593925, 'last_price_update_time': 1774371183.593942, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980894') HTTP/1.1" 204 0
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/7.jpg not downloaded yet
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd71d0>
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/3.jpg saved to cache
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5750>
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/2.jpg saved to cache
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cef110>
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/8.jpg saved to cache
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/8.jpg not downloaded yet
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:04 [ayvens.fr] INFO: Found listing with ID: 1980897
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980897%27 HTTP/1.1" 200 None
2026-03-24 16:53:04 [ayvens.fr] INFO: Scrape type for 1980897: 1
2026-03-24 16:53:04 [ayvens.fr] INFO: Extracting data for car ID: 1980897
2026-03-24 16:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be091d48-fc42-5e72-bb17-0aad979c65f1 with identifier: 1980897
2026-03-24 16:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be091d48-fc42-5e72-bb17-0aad979c65f1 with scrape type 1
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/1.jpg not downloaded yet
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5b50>
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/1.jpg saved to cache
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b6aa50>
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/5.jpg saved to cache
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5724c50>
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/4.jpg saved to cache
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5725890>
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/6.jpg saved to cache
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e61a3d50>
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F0ca6112858a44a2494fea67263125ec4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/7.jpg saved to cache
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d26c7c9b-9987-58cb-8234-c30e1ae2e884
2026-03-24 16:53:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d26c7c9b-9987-58cb-8234-c30e1ae2e884, skipping ID generation
2026-03-24 16:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26c7c9b-9987-58cb-8234-c30e1ae2e884 with scrape type 1
2026-03-24 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d26c7c9b-9987-58cb-8234-c30e1ae2e884 sending to next pipeline
2026-03-24 16:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d26c7c9b-9987-58cb-8234-c30e1ae2e884, identifier: 1980895
2026-03-24 16:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d26c7c9b-9987-58cb-8234-c30e1ae2e884 with identifier: 1980895
2026-03-24 16:53:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d26c7c9b-9987-58cb-8234-c30e1ae2e884 with identifier: 1980895
2026-03-24 16:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d26c7c9b-9987-58cb-8234-c30e1ae2e884 with identifier: 1980895 to the API
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'BLEU COSMOS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'd26c7c9b-9987-58cb-8234-c30e1ae2e884',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 77625,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365600,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26c7c9b-9987-58cb-8234-c30e1ae2e884/d26c7c9b-9987-58cb-8234-c30e1ae2e884_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/0ca6112858a44a2494fea67263125ec4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.3 TCe 140ch FAP Intens EDC',
'transmission': 'automatic',
'trim': 'Megane Estate 1.3 TCe 140ch FAP Intens EDC',
'vin': None,
'year': 2021}
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980895%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [ayvens.fr] INFO: Saving data for 1980895: {'created_time': 1774371185.039449, 'last_price_update_time': 1774371185.039464, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980895') HTTP/1.1" 204 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/2.jpg not downloaded yet
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4598890>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/1.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6367450>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/2.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/3.jpg not downloaded yet
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/4.jpg not downloaded yet
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e9476c90>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/4.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f61d0>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/3.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/5.jpg not downloaded yet
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629f3d0>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/5.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b8f90>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/6.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/6.jpg not downloaded yet
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/7.jpg not downloaded yet
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d1ff50>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/7.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/8.jpg not downloaded yet
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:05 [ayvens.fr] INFO: Found listing with ID: 1980898
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980898%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [ayvens.fr] INFO: Scrape type for 1980898: 1
2026-03-24 16:53:05 [ayvens.fr] INFO: Extracting data for car ID: 1980898
2026-03-24 16:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 with identifier: 1980898
2026-03-24 16:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 with scrape type 1
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/1.jpg not downloaded yet
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6235c10>
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F56e3bfc0e32b411c8978115b7d2132a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/8.jpg saved to cache
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 669428f4-10f1-5e78-9432-65517dfd5cf2
2026-03-24 16:53:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 669428f4-10f1-5e78-9432-65517dfd5cf2, skipping ID generation
2026-03-24 16:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669428f4-10f1-5e78-9432-65517dfd5cf2 with scrape type 1
2026-03-24 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 669428f4-10f1-5e78-9432-65517dfd5cf2 sending to next pipeline
2026-03-24 16:53:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 669428f4-10f1-5e78-9432-65517dfd5cf2, identifier: 1980896
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/2.jpg not downloaded yet
2026-03-24 16:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 669428f4-10f1-5e78-9432-65517dfd5cf2 with identifier: 1980896
2026-03-24 16:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 669428f4-10f1-5e78-9432-65517dfd5cf2 with identifier: 1980896
2026-03-24 16:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 669428f4-10f1-5e78-9432-65517dfd5cf2 with identifier: 1980896 to the API
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '669428f4-10f1-5e78-9432-65517dfd5cf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 120989,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_669428f4-10f1-5e78-9432-65517dfd5cf2/669428f4-10f1-5e78-9432-65517dfd5cf2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/56e3bfc0e32b411c8978115b7d2132a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Nav',
'vin': None,
'year': 2022}
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980896%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [ayvens.fr] INFO: Saving data for 1980896: {'created_time': 1774371186.349505, 'last_price_update_time': 1774371186.349517, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980896') HTTP/1.1" 204 0
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/3.jpg not downloaded yet
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5726c10>
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/2.jpg saved to cache
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6365590>
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/1.jpg saved to cache
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6ac90>
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/3.jpg saved to cache
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/4.jpg not downloaded yet
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/5.jpg not downloaded yet
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/6.jpg not downloaded yet
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 4 pages/min), scraped 288 items (at 37 items/min)
2026-03-24 16:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/7.jpg not downloaded yet
2026-03-24 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/8.jpg not downloaded yet
2026-03-24 16:53:06 [ayvens.fr] INFO: Found listing with ID: 1980899
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980899%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [ayvens.fr] INFO: Scrape type for 1980899: 1
2026-03-24 16:53:06 [ayvens.fr] INFO: Extracting data for car ID: 1980899
2026-03-24 16:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e with identifier: 1980899
2026-03-24 16:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e with scrape type 1
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/1.jpg not downloaded yet
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/2.jpg not downloaded yet
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/3.jpg not downloaded yet
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/4.jpg not downloaded yet
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4df90>
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/7.jpg saved to cache
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc2950>
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/5.jpg saved to cache
2026-03-24 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b6190>
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/4.jpg saved to cache
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8d10>
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/6.jpg saved to cache
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/5.jpg not downloaded yet
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4556a10>
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F92c4c6edd5dd43c68bef7f5a04d48b0b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/8.jpg saved to cache
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be091d48-fc42-5e72-bb17-0aad979c65f1
2026-03-24 16:53:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be091d48-fc42-5e72-bb17-0aad979c65f1, skipping ID generation
2026-03-24 16:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be091d48-fc42-5e72-bb17-0aad979c65f1 with scrape type 1
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be091d48-fc42-5e72-bb17-0aad979c65f1 sending to next pipeline
2026-03-24 16:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: be091d48-fc42-5e72-bb17-0aad979c65f1, identifier: 1980897
2026-03-24 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: be091d48-fc42-5e72-bb17-0aad979c65f1 with identifier: 1980897
2026-03-24 16:53:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: be091d48-fc42-5e72-bb17-0aad979c65f1 with identifier: 1980897
2026-03-24 16:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: be091d48-fc42-5e72-bb17-0aad979c65f1 with identifier: 1980897 to the API
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'COOL WHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'be091d48-fc42-5e72-bb17-0aad979c65f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'SUZUKI',
'model': 'VITARA',
'odometer': 91359,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532041,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532041,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be091d48-fc42-5e72-bb17-0aad979c65f1/be091d48-fc42-5e72-bb17-0aad979c65f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/92c4c6edd5dd43c68bef7f5a04d48b0b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'SUZUKI VITARA Vitara 1.4 Boosterjet Hybrid 129ch Privilège',
'transmission': 'manual',
'trim': 'Vitara 1.4 Boosterjet Hybrid 129ch Privilège',
'vin': None,
'year': 2023}
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980897%27 HTTP/1.1" 200 None
2026-03-24 16:53:07 [ayvens.fr] INFO: Saving data for 1980897: {'created_time': 1774371187.742678, 'last_price_update_time': 1774371187.742689, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980897') HTTP/1.1" 204 0
2026-03-24 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/6.jpg not downloaded yet
2026-03-24 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bbb590>
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/1.jpg saved to cache
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/7.jpg not downloaded yet
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45c0410>
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/2.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c7a110>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/3.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/8.jpg not downloaded yet
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60ec150>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/5.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [ayvens.fr] INFO: Found listing with ID: 1980900
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980900%27 HTTP/1.1" 200 None
2026-03-24 16:53:08 [ayvens.fr] INFO: Scrape type for 1980900: 1
2026-03-24 16:53:08 [ayvens.fr] INFO: Extracting data for car ID: 1980900
2026-03-24 16:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 with identifier: 1980900
2026-03-24 16:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 with scrape type 1
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/1.jpg not downloaded yet
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5709910>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/7.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e617c290>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/6.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e629cd10>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/1.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/2.jpg not downloaded yet
2026-03-24 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b63dd0>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/8.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456fed0>
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F278e3d036ba6499fa1f2a44dc949e8de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/4.jpg saved to cache
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6
2026-03-24 16:53:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3ab6e0d-8107-576b-a05e-4d0fc0938fd6, skipping ID generation
2026-03-24 16:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 with scrape type 1
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 sending to next pipeline
2026-03-24 16:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e3ab6e0d-8107-576b-a05e-4d0fc0938fd6, identifier: 1980898
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/3.jpg not downloaded yet
2026-03-24 16:53:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 with identifier: 1980898
2026-03-24 16:53:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 with identifier: 1980898
2026-03-24 16:53:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e3ab6e0d-8107-576b-a05e-4d0fc0938fd6 with identifier: 1980898 to the API
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'e3ab6e0d-8107-576b-a05e-4d0fc0938fd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 132173,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412623,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ab6e0d-8107-576b-a05e-4d0fc0938fd6/e3ab6e0d-8107-576b-a05e-4d0fc0938fd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/278e3d036ba6499fa1f2a44dc949e8de/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-10',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980898%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [ayvens.fr] INFO: Saving data for 1980898: {'created_time': 1774371189.0967, 'last_price_update_time': 1774371189.096712, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980898') HTTP/1.1" 204 0
2026-03-24 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/4.jpg not downloaded yet
2026-03-24 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b4fd0>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/3.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b9290>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/2.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c71150>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/5.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/5.jpg not downloaded yet
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/6.jpg not downloaded yet
2026-03-24 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b95d0>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/4.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60abd50>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/6.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b6050>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/7.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/7.jpg not downloaded yet
2026-03-24 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/8.jpg not downloaded yet
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8690>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F522b5bc85b614c3bbd5665d7aefab9e8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/8.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e
2026-03-24 16:53:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e, skipping ID generation
2026-03-24 16:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e with scrape type 1
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e sending to next pipeline
2026-03-24 16:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e, identifier: 1980899
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc3c50>
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/1.jpg saved to cache
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:09 [ayvens.fr] INFO: Found listing with ID: 1980901
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980901%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [ayvens.fr] INFO: Scrape type for 1980901: 1
2026-03-24 16:53:09 [ayvens.fr] INFO: Extracting data for car ID: 1980901
2026-03-24 16:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f7b725-ce5d-505b-a11d-423457a3731d with identifier: 1980901
2026-03-24 16:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f7b725-ce5d-505b-a11d-423457a3731d with scrape type 1
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/1.jpg not downloaded yet
2026-03-24 16:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e with identifier: 1980899
2026-03-24 16:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e with identifier: 1980899
2026-03-24 16:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e with identifier: 1980899 to the API
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 98807,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317598,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e/21a6fe2b-c2c5-5cda-8f60-cdd84fd7b94e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/522b5bc85b614c3bbd5665d7aefab9e8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.3 TCe 115ch FAP Business',
'transmission': 'manual',
'trim': 'Megane Estate 1.3 TCe 115ch FAP Business',
'vin': None,
'year': 2020}
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980899%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [ayvens.fr] INFO: Saving data for 1980899: {'created_time': 1774371190.332759, 'last_price_update_time': 1774371190.332768, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980899') HTTP/1.1" 204 0
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/2.jpg not downloaded yet
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bc03d0>
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/2.jpg saved to cache
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/3.jpg not downloaded yet
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/4.jpg not downloaded yet
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b4490>
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/4.jpg saved to cache
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e60a8ad0>
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/3.jpg saved to cache
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/5.jpg not downloaded yet
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/6.jpg not downloaded yet
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccdfd0>
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/5.jpg saved to cache
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cbbb10>
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/6.jpg saved to cache
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6127810>
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/7.jpg saved to cache
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/7.jpg not downloaded yet
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/8.jpg not downloaded yet
2026-03-24 16:53:10 [ayvens.fr] INFO: Found listing with ID: 1980902
2026-03-24 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980902%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [ayvens.fr] INFO: Scrape type for 1980902: 1
2026-03-24 16:53:11 [ayvens.fr] INFO: Extracting data for car ID: 1980902
2026-03-24 16:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 with identifier: 1980902
2026-03-24 16:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 with scrape type 1
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/1.jpg not downloaded yet
2026-03-24 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/2.jpg not downloaded yet
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/3.jpg not downloaded yet
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fbb50>
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fep-%252F09215b94be6040ffa666f21d7ae14719%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/8.jpg saved to cache
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221
2026-03-24 16:53:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f87c8c3-a6e2-5937-a99d-6d3129f8b221, skipping ID generation
2026-03-24 16:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 with scrape type 1
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 sending to next pipeline
2026-03-24 16:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2f87c8c3-a6e2-5937-a99d-6d3129f8b221, identifier: 1980900
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/4.jpg not downloaded yet
2026-03-24 16:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 with identifier: 1980900
2026-03-24 16:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 with identifier: 1980900
2026-03-24 16:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2f87c8c3-a6e2-5937-a99d-6d3129f8b221 with identifier: 1980900 to the API
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '2f87c8c3-a6e2-5937-a99d-6d3129f8b221',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 71255,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f87c8c3-a6e2-5937-a99d-6d3129f8b221/2f87c8c3-a6e2-5937-a99d-6d3129f8b221_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ep-/09215b94be6040ffa666f21d7ae14719/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-26',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Long 2.0 BlueHDi 120ch Premium S&S',
'transmission': 'manual',
'trim': 'Expert Fg Long 2.0 BlueHDi 120ch Premium S&S',
'vin': None,
'year': 2017}
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980900%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [ayvens.fr] INFO: Saving data for 1980900: {'created_time': 1774371191.618628, 'last_price_update_time': 1774371191.618639, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980900') HTTP/1.1" 204 0
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d13cd0>
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/1.jpg saved to cache
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e573bbd0>
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/2.jpg saved to cache
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/5.jpg not downloaded yet
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf8750>
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/3.jpg saved to cache
2026-03-24 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d28350>
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/4.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/6.jpg not downloaded yet
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/7.jpg not downloaded yet
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/8.jpg not downloaded yet
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [ayvens.fr] INFO: Found listing with ID: 1980903
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980903%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [ayvens.fr] INFO: Scrape type for 1980903: 1
2026-03-24 16:53:12 [ayvens.fr] INFO: Extracting data for car ID: 1980903
2026-03-24 16:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3cfec8-186e-56af-8369-4033a4936b88 with identifier: 1980903
2026-03-24 16:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3cfec8-186e-56af-8369-4033a4936b88 with scrape type 1
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/1.jpg not downloaded yet
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/2.jpg not downloaded yet
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/3.jpg not downloaded yet
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68dd0>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/7.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5727f90>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/5.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/4.jpg not downloaded yet
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6094890>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/6.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/5.jpg not downloaded yet
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e05cd0>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F17aba0ccfab845cdadba3ca5132b3975%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/8.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2f7b725-ce5d-505b-a11d-423457a3731d
2026-03-24 16:53:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2f7b725-ce5d-505b-a11d-423457a3731d, skipping ID generation
2026-03-24 16:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f7b725-ce5d-505b-a11d-423457a3731d with scrape type 1
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2f7b725-ce5d-505b-a11d-423457a3731d sending to next pipeline
2026-03-24 16:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e2f7b725-ce5d-505b-a11d-423457a3731d, identifier: 1980901
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bca6d0>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/1.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68210>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/2.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d09390>
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/3.jpg saved to cache
2026-03-24 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e2f7b725-ce5d-505b-a11d-423457a3731d with identifier: 1980901
2026-03-24 16:53:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e2f7b725-ce5d-505b-a11d-423457a3731d with identifier: 1980901
2026-03-24 16:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e2f7b725-ce5d-505b-a11d-423457a3731d with identifier: 1980901 to the API
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 55,
'color': 'MIDNIGHT BLACK',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'e2f7b725-ce5d-505b-a11d-423457a3731d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 61432,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2f7b725-ce5d-505b-a11d-423457a3731d/e2f7b725-ce5d-505b-a11d-423457a3731d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/17aba0ccfab845cdadba3ca5132b3975/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'MINI COUNTRYMAN Countryman Cooper SE 136ch + 88ch Longstone ALL4 '
'BVA6 7cv',
'transmission': 'automatic',
'trim': 'Countryman Cooper SE 136ch + 88ch Longstone ALL4 BVA6 7cv',
'vin': None,
'year': 2019}
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980901%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [ayvens.fr] INFO: Saving data for 1980901: {'created_time': 1774371193.427806, 'last_price_update_time': 1774371193.427818, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980901') HTTP/1.1" 204 0
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/6.jpg not downloaded yet
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/7.jpg not downloaded yet
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d00650>
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/7.jpg saved to cache
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/8.jpg not downloaded yet
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:13 [ayvens.fr] INFO: Found listing with ID: 1980904
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980904%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [ayvens.fr] INFO: Scrape type for 1980904: 1
2026-03-24 16:53:13 [ayvens.fr] INFO: Extracting data for car ID: 1980904
2026-03-24 16:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e17a43c-ec9c-55d1-b113-5f47419f345c with identifier: 1980904
2026-03-24 16:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e17a43c-ec9c-55d1-b113-5f47419f345c with scrape type 1
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/1.jpg not downloaded yet
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/2.jpg not downloaded yet
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5ffd0>
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/4.jpg saved to cache
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ce8f90>
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/5.jpg saved to cache
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7dec590>
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/6.jpg saved to cache
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/3.jpg not downloaded yet
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e570a6d0>
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/1.jpg saved to cache
2026-03-24 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/4.jpg not downloaded yet
2026-03-24 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ccedd0>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/2.jpg saved to cache
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6094110>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5eec37ed22304d9f9153fd67bb4ff073%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/8.jpg saved to cache
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325
2026-03-24 16:53:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325, skipping ID generation
2026-03-24 16:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 with scrape type 1
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 sending to next pipeline
2026-03-24 16:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325, identifier: 1980902
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6147fd0>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/3.jpg saved to cache
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/5.jpg not downloaded yet
2026-03-24 16:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 with identifier: 1980902
2026-03-24 16:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 with identifier: 1980902
2026-03-24 16:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325 with identifier: 1980902 to the API
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 108903,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325/41cc1fe8-39c2-5e2d-8c25-c97ae1bf9325_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5eec37ed22304d9f9153fd67bb4ff073/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-11',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S GT Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S GT Pack EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980902%27 HTTP/1.1" 200 None
2026-03-24 16:53:14 [ayvens.fr] INFO: Saving data for 1980902: {'created_time': 1774371194.687374, 'last_price_update_time': 1774371194.687386, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980902') HTTP/1.1" 204 0
2026-03-24 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/6.jpg not downloaded yet
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c07510>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/5.jpg saved to cache
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb6b50>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/4.jpg saved to cache
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cbbb10>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/7.jpg saved to cache
2026-03-24 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb5410>
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/8.jpg saved to cache
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/7.jpg not downloaded yet
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/8.jpg not downloaded yet
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52f56bedd0>
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd59d8f95c9924a32a1b4a991704b6b45%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/6.jpg saved to cache
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd3cfec8-186e-56af-8369-4033a4936b88
2026-03-24 16:53:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd3cfec8-186e-56af-8369-4033a4936b88, skipping ID generation
2026-03-24 16:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3cfec8-186e-56af-8369-4033a4936b88 with scrape type 1
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd3cfec8-186e-56af-8369-4033a4936b88 sending to next pipeline
2026-03-24 16:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dd3cfec8-186e-56af-8369-4033a4936b88, identifier: 1980903
2026-03-24 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dd3cfec8-186e-56af-8369-4033a4936b88 with identifier: 1980903
2026-03-24 16:53:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dd3cfec8-186e-56af-8369-4033a4936b88 with identifier: 1980903
2026-03-24 16:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dd3cfec8-186e-56af-8369-4033a4936b88 with identifier: 1980903 to the API
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': 'ORANGE PULSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'dd3cfec8-186e-56af-8369-4033a4936b88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'Q3 SPORTBACK',
'odometer': 80010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407255,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3cfec8-186e-56af-8369-4033a4936b88/dd3cfec8-186e-56af-8369-4033a4936b88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d59d8f95c9924a32a1b4a991704b6b45/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI Q3 SPORTBACK Q3 Sportback 35 TDI 150ch Business line S tronic '
'7',
'transmission': 'automatic',
'trim': 'Q3 Sportback 35 TDI 150ch Business line S tronic 7',
'vin': None,
'year': 2022}
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980903%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [ayvens.fr] INFO: Saving data for 1980903: {'created_time': 1774371195.550258, 'last_price_update_time': 1774371195.550269, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980903') HTTP/1.1" 204 0
2026-03-24 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:15 [ayvens.fr] INFO: Found listing with ID: 1980905
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980905%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [ayvens.fr] INFO: Scrape type for 1980905: 1
2026-03-24 16:53:15 [ayvens.fr] INFO: Extracting data for car ID: 1980905
2026-03-24 16:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 with identifier: 1980905
2026-03-24 16:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 with scrape type 1
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/1.jpg not downloaded yet
2026-03-24 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/2.jpg not downloaded yet
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d58910>
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/1.jpg saved to cache
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d3750>
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/2.jpg saved to cache
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/3.jpg not downloaded yet
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/4.jpg not downloaded yet
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6a250>
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/3.jpg saved to cache
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b64d0>
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/4.jpg saved to cache
2026-03-24 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/5.jpg not downloaded yet
2026-03-24 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/6.jpg not downloaded yet
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c60490>
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/5.jpg saved to cache
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d2850>
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/6.jpg saved to cache
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/7.jpg not downloaded yet
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/8.jpg not downloaded yet
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45b5850>
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/7.jpg saved to cache
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:16 [ayvens.fr] INFO: Found listing with ID: 1980906
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980906%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [ayvens.fr] INFO: Scrape type for 1980906: 1
2026-03-24 16:53:16 [ayvens.fr] INFO: Extracting data for car ID: 1980906
2026-03-24 16:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a96734cc-36fc-5126-801c-320d3f8087ef with identifier: 1980906
2026-03-24 16:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96734cc-36fc-5126-801c-320d3f8087ef with scrape type 1
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/1.jpg not downloaded yet
2026-03-24 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/2.jpg not downloaded yet
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cac190>
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F88c7c91961e84c9a84ba04ea388f07da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/8.jpg saved to cache
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e17a43c-ec9c-55d1-b113-5f47419f345c
2026-03-24 16:53:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e17a43c-ec9c-55d1-b113-5f47419f345c, skipping ID generation
2026-03-24 16:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e17a43c-ec9c-55d1-b113-5f47419f345c with scrape type 1
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e17a43c-ec9c-55d1-b113-5f47419f345c sending to next pipeline
2026-03-24 16:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5e17a43c-ec9c-55d1-b113-5f47419f345c, identifier: 1980904
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/3.jpg not downloaded yet
2026-03-24 16:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5e17a43c-ec9c-55d1-b113-5f47419f345c with identifier: 1980904
2026-03-24 16:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5e17a43c-ec9c-55d1-b113-5f47419f345c with identifier: 1980904
2026-03-24 16:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5e17a43c-ec9c-55d1-b113-5f47419f345c with identifier: 1980904 to the API
2026-03-24 16:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5e17a43c-ec9c-55d1-b113-5f47419f345c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 16198,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17a43c-ec9c-55d1-b113-5f47419f345c/5e17a43c-ec9c-55d1-b113-5f47419f345c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/88c7c91961e84c9a84ba04ea388f07da/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-07-18',
'seats_number': 2,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris Affaires 116h Dynamic Business Affaire',
'transmission': 'automatic',
'trim': 'Yaris Affaires 116h Dynamic Business Affaire',
'vin': None,
'year': 2024}
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980904%27 HTTP/1.1" 200 None
2026-03-24 16:53:17 [ayvens.fr] INFO: Saving data for 1980904: {'created_time': 1774371197.119322, 'last_price_update_time': 1774371197.11934, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980904') HTTP/1.1" 204 0
2026-03-24 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/4.jpg not downloaded yet
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f4510>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/1.jpg saved to cache
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45d3610>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/2.jpg saved to cache
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e613ea10>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/3.jpg saved to cache
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68450>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/4.jpg saved to cache
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/5.jpg not downloaded yet
2026-03-24 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/6.jpg not downloaded yet
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56cb790>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/5.jpg saved to cache
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5fdd0>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/6.jpg saved to cache
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/7.jpg not downloaded yet
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/8.jpg not downloaded yet
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cae510>
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/7.jpg saved to cache
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611a590>
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe91cf500ebf34153851cfd5d7928283f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/8.jpg saved to cache
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171
2026-03-24 16:53:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171, skipping ID generation
2026-03-24 16:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 with scrape type 1
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 sending to next pipeline
2026-03-24 16:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171, identifier: 1980905
2026-03-24 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 with identifier: 1980905
2026-03-24 16:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 with identifier: 1980905
2026-03-24 16:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171 with identifier: 1980905 to the API
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 10293,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270759,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171/b9fa9d35-c35e-59e5-91ba-4a4dc3a5f171_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e91cf500ebf34153851cfd5d7928283f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-30',
'seats_number': 2,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris Affaires 116h Dynamic Business Affaire',
'transmission': 'automatic',
'trim': 'Yaris Affaires 116h Dynamic Business Affaire',
'vin': None,
'year': 2024}
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980905%27 HTTP/1.1" 200 None
2026-03-24 16:53:18 [ayvens.fr] INFO: Saving data for 1980905: {'created_time': 1774371198.537451, 'last_price_update_time': 1774371198.537467, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980905') HTTP/1.1" 204 0
2026-03-24 16:53:18 [ayvens.fr] INFO: Found listing with ID: 1980907
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980907%27 HTTP/1.1" 200 None
2026-03-24 16:53:18 [ayvens.fr] INFO: Scrape type for 1980907: 1
2026-03-24 16:53:18 [ayvens.fr] INFO: Extracting data for car ID: 1980907
2026-03-24 16:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 565048d0-d40e-5668-9e36-2c1906c0410f with identifier: 1980907
2026-03-24 16:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565048d0-d40e-5668-9e36-2c1906c0410f with scrape type 1
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/1.jpg not downloaded yet
2026-03-24 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/2.jpg not downloaded yet
2026-03-24 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d4e5d0>
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/1.jpg saved to cache
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/3.jpg not downloaded yet
2026-03-24 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/4.jpg not downloaded yet
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4577190>
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/2.jpg saved to cache
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b611d0>
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/4.jpg saved to cache
2026-03-24 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d29c90>
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/3.jpg saved to cache
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/5.jpg not downloaded yet
2026-03-24 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/6.jpg not downloaded yet
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e45773d0>
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/5.jpg saved to cache
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b57410>
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/6.jpg saved to cache
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/7.jpg not downloaded yet
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/8.jpg not downloaded yet
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cc6810>
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/7.jpg saved to cache
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e64f6890>
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df6feb6194f434b97fc22c1f9de4be9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/8.jpg saved to cache
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a96734cc-36fc-5126-801c-320d3f8087ef
2026-03-24 16:53:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a96734cc-36fc-5126-801c-320d3f8087ef, skipping ID generation
2026-03-24 16:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96734cc-36fc-5126-801c-320d3f8087ef with scrape type 1
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a96734cc-36fc-5126-801c-320d3f8087ef sending to next pipeline
2026-03-24 16:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a96734cc-36fc-5126-801c-320d3f8087ef, identifier: 1980906
2026-03-24 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:19 [ayvens.fr] INFO: Found listing with ID: 1980908
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980908%27 HTTP/1.1" 200 None
2026-03-24 16:53:19 [ayvens.fr] INFO: Scrape type for 1980908: 1
2026-03-24 16:53:19 [ayvens.fr] INFO: Extracting data for car ID: 1980908
2026-03-24 16:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7d4929-4567-50a3-94d5-30d470323adc with identifier: 1980908
2026-03-24 16:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7d4929-4567-50a3-94d5-30d470323adc with scrape type 1
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/1.jpg not downloaded yet
2026-03-24 16:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a96734cc-36fc-5126-801c-320d3f8087ef with identifier: 1980906
2026-03-24 16:53:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a96734cc-36fc-5126-801c-320d3f8087ef with identifier: 1980906
2026-03-24 16:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a96734cc-36fc-5126-801c-320d3f8087ef with identifier: 1980906 to the API
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'MINERALGRAU M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': 'a96734cc-36fc-5126-801c-320d3f8087ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 56123,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96734cc-36fc-5126-801c-320d3f8087ef/a96734cc-36fc-5126-801c-320d3f8087ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df6feb6194f434b97fc22c1f9de4be9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18dA 150ch M Sport',
'transmission': 'automatic',
'trim': 'X1 sDrive18dA 150ch M Sport',
'vin': None,
'year': 2022}
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980906%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [ayvens.fr] INFO: Saving data for 1980906: {'created_time': 1774371200.000556, 'last_price_update_time': 1774371200.000571, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980906') HTTP/1.1" 204 0
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/2.jpg not downloaded yet
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d5c310>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/1.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dc3450>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/2.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/3.jpg not downloaded yet
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/4.jpg not downloaded yet
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e611b390>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/4.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d60610>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/3.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/5.jpg not downloaded yet
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/6.jpg not downloaded yet
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5be8810>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/6.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5708790>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/5.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6101f10>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/7.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/7.jpg not downloaded yet
2026-03-24 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/8.jpg not downloaded yet
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cb8e10>
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ffb8f52e73e4241b8948bebad8c1eaf56%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/8.jpg saved to cache
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 565048d0-d40e-5668-9e36-2c1906c0410f
2026-03-24 16:53:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 565048d0-d40e-5668-9e36-2c1906c0410f, skipping ID generation
2026-03-24 16:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565048d0-d40e-5668-9e36-2c1906c0410f with scrape type 1
2026-03-24 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 565048d0-d40e-5668-9e36-2c1906c0410f sending to next pipeline
2026-03-24 16:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 565048d0-d40e-5668-9e36-2c1906c0410f, identifier: 1980907
2026-03-24 16:53:21 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-24 16:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 565048d0-d40e-5668-9e36-2c1906c0410f with identifier: 1980907
2026-03-24 16:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 565048d0-d40e-5668-9e36-2c1906c0410f with identifier: 1980907
2026-03-24 16:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 565048d0-d40e-5668-9e36-2c1906c0410f with identifier: 1980907 to the API
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'SAPHIRSCHWARZ M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': '565048d0-d40e-5668-9e36-2c1906c0410f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 64979,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565048d0-d40e-5668-9e36-2c1906c0410f/565048d0-d40e-5668-9e36-2c1906c0410f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/fb8f52e73e4241b8948bebad8c1eaf56/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18i 136ch xLine First Edition',
'transmission': 'automatic',
'trim': 'X1 sDrive18i 136ch xLine First Edition',
'vin': None,
'year': 2022}
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980907%27 HTTP/1.1" 200 None
2026-03-24 16:53:21 [ayvens.fr] INFO: Saving data for 1980907: {'created_time': 1774371201.378393, 'last_price_update_time': 1774371201.378405, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980907') HTTP/1.1" 204 0
2026-03-24 16:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 16:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7a0c850>
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/1.jpg saved to cache
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5da4a50>
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/2.jpg saved to cache
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e79fbc90>
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/3.jpg saved to cache
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5dd5a10>
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/4.jpg saved to cache
2026-03-24 16:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d72f10>
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/6.jpg saved to cache
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d2ac50>
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/5.jpg saved to cache
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c6a710>
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/7.jpg saved to cache
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7b680d0>
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F9ee70c8349754e51b5274fd2e70877d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/8.jpg saved to cache
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa7d4929-4567-50a3-94d5-30d470323adc
2026-03-24 16:53:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa7d4929-4567-50a3-94d5-30d470323adc, skipping ID generation
2026-03-24 16:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7d4929-4567-50a3-94d5-30d470323adc with scrape type 1
2026-03-24 16:53:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa7d4929-4567-50a3-94d5-30d470323adc sending to next pipeline
2026-03-24 16:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fa7d4929-4567-50a3-94d5-30d470323adc, identifier: 1980908
2026-03-24 16:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fa7d4929-4567-50a3-94d5-30d470323adc with identifier: 1980908
2026-03-24 16:53:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fa7d4929-4567-50a3-94d5-30d470323adc with identifier: 1980908
2026-03-24 16:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fa7d4929-4567-50a3-94d5-30d470323adc with identifier: 1980908 to the API
2026-03-24 16:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'color': 'BLUESTONE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'petrol',
'id': 'fa7d4929-4567-50a3-94d5-30d470323adc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 5',
'odometer': 167987,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7d4929-4567-50a3-94d5-30d470323adc/fa7d4929-4567-50a3-94d5-30d470323adc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/9ee70c8349754e51b5274fd2e70877d1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 5 Serie 5 Touring 520iA 184ch M Sport Steptronic',
'transmission': 'automatic',
'trim': 'Serie 5 Touring 520iA 184ch M Sport Steptronic',
'vin': None,
'year': 2020}
2026-03-24 16:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980908%27 HTTP/1.1" 200 None
2026-03-24 16:53:23 [ayvens.fr] INFO: Saving data for 1980908: {'created_time': 1774371203.420519, 'last_price_update_time': 1774371203.420532, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980908') HTTP/1.1" 204 0
2026-03-24 16:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 16:53:25 [ayvens.fr] INFO: Found listing with ID: 1980909
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980909%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [ayvens.fr] INFO: Scrape type for 1980909: 1
2026-03-24 16:53:25 [ayvens.fr] INFO: Extracting data for car ID: 1980909
2026-03-24 16:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec6cb4d-3b02-5395-9ed1-c182ec345832 with identifier: 1980909
2026-03-24 16:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832 with scrape type 1
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/1.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/2.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/3.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/4.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/5.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/6.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/7.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/8.jpg not downloaded yet
2026-03-24 16:53:25 [ayvens.fr] INFO: Found listing with ID: 1980910
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980910%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [ayvens.fr] INFO: Scrape type for 1980910: 1
2026-03-24 16:53:25 [ayvens.fr] INFO: Extracting data for car ID: 1980910
2026-03-24 16:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f6df66-8d98-5aa6-8960-de14f989ecf1 with identifier: 1980910
2026-03-24 16:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f6df66-8d98-5aa6-8960-de14f989ecf1 with scrape type 1
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/1.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/2.jpg not downloaded yet
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/3.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/4.jpg not downloaded yet
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/5.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/6.jpg not downloaded yet
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/7.jpg not downloaded yet
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/8.jpg not downloaded yet
2026-03-24 16:53:25 [ayvens.fr] INFO: Found listing with ID: 1980911
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980911%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [ayvens.fr] INFO: Scrape type for 1980911: 1
2026-03-24 16:53:25 [ayvens.fr] INFO: Extracting data for car ID: 1980911
2026-03-24 16:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164598ae-cbd0-56a8-8cf0-7d0855edc836 with identifier: 1980911
2026-03-24 16:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164598ae-cbd0-56a8-8cf0-7d0855edc836 with scrape type 1
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/1.jpg not downloaded yet
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6234a50>
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/1.jpg saved to cache
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/2.jpg not downloaded yet
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e32bd0>
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/4.jpg saved to cache
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/3.jpg not downloaded yet
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/4.jpg not downloaded yet
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5e0c1d0>
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/2.jpg saved to cache
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b628d0>
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/5.jpg saved to cache
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e4577ed0>
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/6.jpg saved to cache
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/5.jpg not downloaded yet
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cee7d0>
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/2.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d57150>
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/1.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/6.jpg not downloaded yet
2026-03-24 16:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/7.jpg not downloaded yet
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e7cf1090>
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/8.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bff050>
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/7.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5ded7d0>
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/3.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bfd950>
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/4.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e619bed0>
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F543a807e3f0c4721854794da225994e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/3.jpg saved to cache
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832
2026-03-24 16:53:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ec6cb4d-3b02-5395-9ed1-c182ec345832, skipping ID generation
2026-03-24 16:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832 with scrape type 1
2026-03-24 16:53:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ec6cb4d-3b02-5395-9ed1-c182ec345832 sending to next pipeline
2026-03-24 16:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4ec6cb4d-3b02-5395-9ed1-c182ec345832, identifier: 1980909
2026-03-24 16:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4ec6cb4d-3b02-5395-9ed1-c182ec345832 with identifier: 1980909
2026-03-24 16:53:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4ec6cb4d-3b02-5395-9ed1-c182ec345832 with identifier: 1980909
2026-03-24 16:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4ec6cb4d-3b02-5395-9ed1-c182ec345832 with identifier: 1980909 to the API
2026-03-24 16:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'GRIS CORRIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'diesel',
'id': '4ec6cb4d-3b02-5395-9ed1-c182ec345832',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 128820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec6cb4d-3b02-5395-9ed1-c182ec345832/4ec6cb4d-3b02-5395-9ed1-c182ec345832_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/543a807e3f0c4721854794da225994e0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'JAGUAR E-PACE E-Pace 2.0D 180ch R-Dynamic SE AWD BVA9',
'transmission': 'automatic',
'trim': 'E-Pace 2.0D 180ch R-Dynamic SE AWD BVA9',
'vin': None,
'year': 2018}
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980909%27 HTTP/1.1" 200 None
2026-03-24 16:53:27 [ayvens.fr] INFO: Saving data for 1980909: {'created_time': 1774371207.180572, 'last_price_update_time': 1774371207.180587, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980909') HTTP/1.1" 204 0
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 16:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/8.jpg not downloaded yet
2026-03-24 16:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c63fd0>
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/5.jpg saved to cache
2026-03-24 16:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5bb4d90>
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/6.jpg saved to cache
2026-03-24 16:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:27 [ayvens.fr] INFO: Found listing with ID: 1977404
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977404%27 HTTP/1.1" 200 None
2026-03-24 16:53:27 [ayvens.fr] INFO: Scrape type for 1977404: 2
2026-03-24 16:53:27 [ayvens.fr] INFO: Extracting data for car ID: 1977404
2026-03-24 16:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7535bad4-72b0-5509-b637-435b87f8d1f2 with identifier: 1977404
2026-03-24 16:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7535bad4-72b0-5509-b637-435b87f8d1f2 with scrape type 2
2026-03-24 16:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7535bad4-72b0-5509-b637-435b87f8d1f2 with scrape type 2
2026-03-24 16:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7535bad4-72b0-5509-b637-435b87f8d1f2, identifier: 1977404
2026-03-24 16:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7535bad4-72b0-5509-b637-435b87f8d1f2 with identifier: 1977404
2026-03-24 16:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7535bad4-72b0-5509-b637-435b87f8d1f2 with identifier: 1977404
2026-03-24 16:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7535bad4-72b0-5509-b637-435b87f8d1f2 with identifier: 1977404 to the API
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '7535bad4-72b0-5509-b637-435b87f8d1f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 148788,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-22',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel',
'vin': None,
'year': 2020}
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977404%27 HTTP/1.1" 200 None
2026-03-24 16:53:27 [ayvens.fr] INFO: Saving data for 1977404: {'auction_closing_time': 1774454400.0, 'created_time': 1774284325.676162, 'last_price_update_time': 1774371207.990932}
2026-03-24 16:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977404') HTTP/1.1" 204 0
2026-03-24 16:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:28 [ayvens.fr] INFO: Found listing with ID: 1977405
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977405%27 HTTP/1.1" 200 None
2026-03-24 16:53:28 [ayvens.fr] INFO: Scrape type for 1977405: 2
2026-03-24 16:53:28 [ayvens.fr] INFO: Extracting data for car ID: 1977405
2026-03-24 16:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b1e39a-c1d8-50e8-bf99-db61289b2a7c with identifier: 1977405
2026-03-24 16:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b1e39a-c1d8-50e8-bf99-db61289b2a7c with scrape type 2
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b1e39a-c1d8-50e8-bf99-db61289b2a7c with scrape type 2
2026-03-24 16:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 10b1e39a-c1d8-50e8-bf99-db61289b2a7c, identifier: 1977405
2026-03-24 16:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 10b1e39a-c1d8-50e8-bf99-db61289b2a7c with identifier: 1977405
2026-03-24 16:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 10b1e39a-c1d8-50e8-bf99-db61289b2a7c with identifier: 1977405
2026-03-24 16:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 10b1e39a-c1d8-50e8-bf99-db61289b2a7c with identifier: 1977405 to the API
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '10b1e39a-c1d8-50e8-bf99-db61289b2a7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 146494,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-31',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Grand '
'Confort',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Grand Confort',
'vin': None,
'year': 2019}
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977405%27 HTTP/1.1" 200 None
2026-03-24 16:53:28 [ayvens.fr] INFO: Saving data for 1977405: {'auction_closing_time': 1774454400.0, 'created_time': 1774284327.159678, 'last_price_update_time': 1774371208.4562}
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977405') HTTP/1.1" 204 0
2026-03-24 16:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:28 [ayvens.fr] INFO: Found listing with ID: 1977406
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977406%27 HTTP/1.1" 200 None
2026-03-24 16:53:28 [ayvens.fr] INFO: Scrape type for 1977406: 2
2026-03-24 16:53:28 [ayvens.fr] INFO: Extracting data for car ID: 1977406
2026-03-24 16:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b7a9db-2167-5fa1-b122-2521bc7a4f1c with identifier: 1977406
2026-03-24 16:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b7a9db-2167-5fa1-b122-2521bc7a4f1c with scrape type 2
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80b7a9db-2167-5fa1-b122-2521bc7a4f1c with scrape type 2
2026-03-24 16:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 80b7a9db-2167-5fa1-b122-2521bc7a4f1c, identifier: 1977406
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5cf1390>
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/8.jpg saved to cache
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e456ec10>
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fcc0a2e31fb144575a774f86c8cb71465%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/7.jpg saved to cache
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19f6df66-8d98-5aa6-8960-de14f989ecf1
2026-03-24 16:53:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19f6df66-8d98-5aa6-8960-de14f989ecf1, skipping ID generation
2026-03-24 16:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f6df66-8d98-5aa6-8960-de14f989ecf1 with scrape type 1
2026-03-24 16:53:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19f6df66-8d98-5aa6-8960-de14f989ecf1 sending to next pipeline
2026-03-24 16:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 19f6df66-8d98-5aa6-8960-de14f989ecf1, identifier: 1980910
2026-03-24 16:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 80b7a9db-2167-5fa1-b122-2521bc7a4f1c with identifier: 1977406
2026-03-24 16:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 80b7a9db-2167-5fa1-b122-2521bc7a4f1c with identifier: 1977406
2026-03-24 16:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 80b7a9db-2167-5fa1-b122-2521bc7a4f1c with identifier: 1977406 to the API
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '80b7a9db-2167-5fa1-b122-2521bc7a4f1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 149892,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.5 Blue dCi 115ch Business -21N',
'transmission': 'manual',
'trim': 'Megane Estate 1.5 Blue dCi 115ch Business -21N',
'vin': None,
'year': 2022}
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977406%27 HTTP/1.1" 200 None
2026-03-24 16:53:29 [ayvens.fr] INFO: Saving data for 1977406: {'auction_closing_time': 1774454400.0, 'created_time': 1774284329.379244, 'last_price_update_time': 1774371209.082525}
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977406') HTTP/1.1" 204 0
2026-03-24 16:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 19f6df66-8d98-5aa6-8960-de14f989ecf1 with identifier: 1980910
2026-03-24 16:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 19f6df66-8d98-5aa6-8960-de14f989ecf1 with identifier: 1980910
2026-03-24 16:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 19f6df66-8d98-5aa6-8960-de14f989ecf1 with identifier: 1980910 to the API
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 26,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '19f6df66-8d98-5aa6-8960-de14f989ecf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'ARTEON',
'odometer': 104820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f6df66-8d98-5aa6-8960-de14f989ecf1/19f6df66-8d98-5aa6-8960-de14f989ecf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/cc0a2e31fb144575a774f86c8cb71465/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN ARTEON Arteon 1.4 TSI eHybrid OPF 218ch R-Line DSG6',
'transmission': 'automatic',
'trim': 'Arteon 1.4 TSI eHybrid OPF 218ch R-Line DSG6',
'vin': None,
'year': 2023}
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980910%27 HTTP/1.1" 200 None
2026-03-24 16:53:29 [ayvens.fr] INFO: Saving data for 1980910: {'created_time': 1774371209.761978, 'last_price_update_time': 1774371209.76199, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980910') HTTP/1.1" 204 0
2026-03-24 16:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:29 [ayvens.fr] INFO: Found listing with ID: 1977407
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977407%27 HTTP/1.1" 200 None
2026-03-24 16:53:29 [ayvens.fr] INFO: Scrape type for 1977407: 2
2026-03-24 16:53:29 [ayvens.fr] INFO: Extracting data for car ID: 1977407
2026-03-24 16:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9174cbe4-31d1-5431-8b79-da46004e18a8 with identifier: 1977407
2026-03-24 16:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9174cbe4-31d1-5431-8b79-da46004e18a8 with scrape type 2
2026-03-24 16:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9174cbe4-31d1-5431-8b79-da46004e18a8 with scrape type 2
2026-03-24 16:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9174cbe4-31d1-5431-8b79-da46004e18a8, identifier: 1977407
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d13810>
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_4.jpg HTTP/1.1" 201 0
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/5.jpg saved to cache
2026-03-24 16:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5c9eb10>
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_1.jpg HTTP/1.1" 201 0
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/2.jpg saved to cache
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e56b1cd0>
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_0.jpg HTTP/1.1" 201 0
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/1.jpg saved to cache
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9174cbe4-31d1-5431-8b79-da46004e18a8 with identifier: 1977407
2026-03-24 16:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9174cbe4-31d1-5431-8b79-da46004e18a8 with identifier: 1977407
2026-03-24 16:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9174cbe4-31d1-5431-8b79-da46004e18a8 with identifier: 1977407 to the API
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '9174cbe4-31d1-5431-8b79-da46004e18a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 144634,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'vin': None,
'year': 2022}
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977407%27 HTTP/1.1" 200 None
2026-03-24 16:53:30 [ayvens.fr] INFO: Saving data for 1977407: {'auction_closing_time': 1774454400.0, 'created_time': 1774284328.698449, 'last_price_update_time': 1774371210.382085}
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977407') HTTP/1.1" 204 0
2026-03-24 16:53:30 [ayvens.fr] INFO: Found listing with ID: 1977408
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977408%27 HTTP/1.1" 200 None
2026-03-24 16:53:30 [ayvens.fr] INFO: Scrape type for 1977408: 2
2026-03-24 16:53:30 [ayvens.fr] INFO: Extracting data for car ID: 1977408
2026-03-24 16:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08e63714-5ac1-5e89-a63e-f0d3b9354b61 with identifier: 1977408
2026-03-24 16:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08e63714-5ac1-5e89-a63e-f0d3b9354b61 with scrape type 2
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08e63714-5ac1-5e89-a63e-f0d3b9354b61 with scrape type 2
2026-03-24 16:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 08e63714-5ac1-5e89-a63e-f0d3b9354b61, identifier: 1977408
2026-03-24 16:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 16:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 08e63714-5ac1-5e89-a63e-f0d3b9354b61 with identifier: 1977408
2026-03-24 16:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 08e63714-5ac1-5e89-a63e-f0d3b9354b61 with identifier: 1977408
2026-03-24 16:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 08e63714-5ac1-5e89-a63e-f0d3b9354b61 with identifier: 1977408 to the API
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '08e63714-5ac1-5e89-a63e-f0d3b9354b61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 148438,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-29',
'seats_number': 7,
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN Touran 2.0 TDI 150ch FAP Lounge Business DSG7 7 '
'places',
'transmission': 'automatic',
'trim': 'Touran 2.0 TDI 150ch FAP Lounge Business DSG7 7 places',
'vin': None,
'year': 2022}
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977408%27 HTTP/1.1" 200 None
2026-03-24 16:53:30 [ayvens.fr] INFO: Saving data for 1977408: {'auction_closing_time': 1774454400.0, 'created_time': 1774284331.634302, 'last_price_update_time': 1774371210.749202}
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977408') HTTP/1.1" 204 0
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b68050>
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_3.jpg HTTP/1.1" 201 0
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/4.jpg saved to cache
2026-03-24 16:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6234b50>
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_2.jpg HTTP/1.1" 201 0
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/3.jpg saved to cache
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5d00850>
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_5.jpg HTTP/1.1" 201 0
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/6.jpg saved to cache
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e5b4f850>
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_6.jpg HTTP/1.1" 201 0
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/7.jpg saved to cache
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:31 [ayvens.fr] INFO: Found listing with ID: 1977409
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977409%27 HTTP/1.1" 200 None
2026-03-24 16:53:31 [ayvens.fr] INFO: Scrape type for 1977409: 2
2026-03-24 16:53:31 [ayvens.fr] INFO: Extracting data for car ID: 1977409
2026-03-24 16:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b12f45-abb4-5558-832f-87d45508362e with identifier: 1977409
2026-03-24 16:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b12f45-abb4-5558-832f-87d45508362e with scrape type 2
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35b12f45-abb4-5558-832f-87d45508362e with scrape type 2
2026-03-24 16:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 35b12f45-abb4-5558-832f-87d45508362e, identifier: 1977409
2026-03-24 16:53:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 35b12f45-abb4-5558-832f-87d45508362e with identifier: 1977409
2026-03-24 16:53:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 35b12f45-abb4-5558-832f-87d45508362e with identifier: 1977409
2026-03-24 16:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 35b12f45-abb4-5558-832f-87d45508362e with identifier: 1977409 to the API
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 162,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '35b12f45-abb4-5558-832f-87d45508362e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 145739,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-21',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L2H2 1200 2.0 dCi 145ch Energy Grand '
'Confort E6',
'transmission': 'manual',
'trim': 'Trafic Fg L2H2 1200 2.0 dCi 145ch Energy Grand Confort E6',
'vin': None,
'year': 2020}
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977409%27 HTTP/1.1" 200 None
2026-03-24 16:53:31 [ayvens.fr] INFO: Saving data for 1977409: {'auction_closing_time': 1774454400.0, 'created_time': 1774284333.035021, 'last_price_update_time': 1774371211.670555}
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977409') HTTP/1.1" 204 0
2026-03-24 16:53:31 [ayvens.fr] INFO: Found listing with ID: 1977410
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977410%27 HTTP/1.1" 200 None
2026-03-24 16:53:31 [ayvens.fr] INFO: Scrape type for 1977410: 2
2026-03-24 16:53:31 [ayvens.fr] INFO: Extracting data for car ID: 1977410
2026-03-24 16:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42d45cd8-e37d-52b1-bf4f-63c845f30db1 with identifier: 1977410
2026-03-24 16:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42d45cd8-e37d-52b1-bf4f-63c845f30db1 with scrape type 2
2026-03-24 16:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42d45cd8-e37d-52b1-bf4f-63c845f30db1 with scrape type 2
2026-03-24 16:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 42d45cd8-e37d-52b1-bf4f-63c845f30db1, identifier: 1977410
2026-03-24 16:53:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 42d45cd8-e37d-52b1-bf4f-63c845f30db1 with identifier: 1977410
2026-03-24 16:53:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 42d45cd8-e37d-52b1-bf4f-63c845f30db1 with identifier: 1977410
2026-03-24 16:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 42d45cd8-e37d-52b1-bf4f-63c845f30db1 with identifier: 1977410 to the API
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 191,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '42d45cd8-e37d-52b1-bf4f-63c845f30db1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 184442,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-15',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3500 L3H3 2.3 dCi 145ch Energy Grand '
'Confort',
'transmission': 'manual',
'trim': 'Master Fg F3500 L3H3 2.3 dCi 145ch Energy Grand Confort',
'vin': None,
'year': 2021}
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977410%27 HTTP/1.1" 200 None
2026-03-24 16:53:32 [ayvens.fr] INFO: Saving data for 1977410: {'auction_closing_time': 1774454400.0, 'created_time': 1774284334.655697, 'last_price_update_time': 1774371212.033045}
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977410') HTTP/1.1" 204 0
2026-03-24 16:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 16:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52e6147110>
2026-03-24 16:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 16:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_7.jpg HTTP/1.1" 201 0
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fd0d5b742cd8c4c5a841ed2de83f2924c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 16:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/8.jpg saved to cache
2026-03-24 16:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 164598ae-cbd0-56a8-8cf0-7d0855edc836
2026-03-24 16:53:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 164598ae-cbd0-56a8-8cf0-7d0855edc836, skipping ID generation
2026-03-24 16:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164598ae-cbd0-56a8-8cf0-7d0855edc836 with scrape type 1
2026-03-24 16:53:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 164598ae-cbd0-56a8-8cf0-7d0855edc836 sending to next pipeline
2026-03-24 16:53:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 164598ae-cbd0-56a8-8cf0-7d0855edc836, identifier: 1980911
2026-03-24 16:53:32 [ayvens.fr] INFO: Found listing with ID: 1977411
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977411%27 HTTP/1.1" 200 None
2026-03-24 16:53:32 [ayvens.fr] INFO: Scrape type for 1977411: 2
2026-03-24 16:53:32 [ayvens.fr] INFO: Extracting data for car ID: 1977411
2026-03-24 16:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252 with identifier: 1977411
2026-03-24 16:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252 with scrape type 2
2026-03-24 16:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252 with scrape type 2
2026-03-24 16:53:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252, identifier: 1977411
2026-03-24 16:53:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 164598ae-cbd0-56a8-8cf0-7d0855edc836 with identifier: 1980911
2026-03-24 16:53:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 164598ae-cbd0-56a8-8cf0-7d0855edc836 with identifier: 1980911
2026-03-24 16:53:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 164598ae-cbd0-56a8-8cf0-7d0855edc836 with identifier: 1980911 to the API
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 49,
'color': 'NOIR ONYX',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-27T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '164598ae-cbd0-56a8-8cf0-7d0855edc836',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40980',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 85992,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164598ae-cbd0-56a8-8cf0-7d0855edc836/164598ae-cbd0-56a8-8cf0-7d0855edc836_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285105,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/d0d5b742cd8c4c5a841ed2de83f2924c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T5 Recharge 180 + 82ch R-Design DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T5 Recharge 180 + 82ch R-Design DCT 7',
'vin': None,
'year': 2021}
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271980911%27 HTTP/1.1" 200 None
2026-03-24 16:53:32 [ayvens.fr] INFO: Saving data for 1980911: {'created_time': 1774371212.691049, 'last_price_update_time': 1774371212.691061, 'auction_closing_time': 1774605600.0}
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1980911') HTTP/1.1" 204 0
2026-03-24 16:53:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252 with identifier: 1977411
2026-03-24 16:53:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252 with identifier: 1977411
2026-03-24 16:53:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252 with identifier: 1977411 to the API
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLEU AVATAR METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '77ce3bd0-a1fa-5bb5-a9d6-cd25374c3252',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 164588,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977411%27 HTTP/1.1" 200 None
2026-03-24 16:53:32 [ayvens.fr] INFO: Saving data for 1977411: {'auction_closing_time': 1774454400.0, 'created_time': 1774284336.452851, 'last_price_update_time': 1774371212.955025}
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977411') HTTP/1.1" 204 0
2026-03-24 16:53:32 [ayvens.fr] INFO: Found listing with ID: 1977412
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977412%27 HTTP/1.1" 200 None
2026-03-24 16:53:32 [ayvens.fr] INFO: Scrape type for 1977412: 2
2026-03-24 16:53:32 [ayvens.fr] INFO: Extracting data for car ID: 1977412
2026-03-24 16:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23829684-7ff5-5ad2-9097-38379b4546f5 with identifier: 1977412
2026-03-24 16:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23829684-7ff5-5ad2-9097-38379b4546f5 with scrape type 2
2026-03-24 16:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23829684-7ff5-5ad2-9097-38379b4546f5 with scrape type 2
2026-03-24 16:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 23829684-7ff5-5ad2-9097-38379b4546f5, identifier: 1977412
2026-03-24 16:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 23829684-7ff5-5ad2-9097-38379b4546f5 with identifier: 1977412
2026-03-24 16:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 23829684-7ff5-5ad2-9097-38379b4546f5 with identifier: 1977412
2026-03-24 16:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 23829684-7ff5-5ad2-9097-38379b4546f5 with identifier: 1977412 to the API
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '23829684-7ff5-5ad2-9097-38379b4546f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 153221,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.5 BlueHDi 100ch S&S Allure Business',
'transmission': 'manual',
'trim': '208 1.5 BlueHDi 100ch S&S Allure Business',
'vin': None,
'year': 2021}
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977412%27 HTTP/1.1" 200 None
2026-03-24 16:53:33 [ayvens.fr] INFO: Saving data for 1977412: {'auction_closing_time': 1774454400.0, 'created_time': 1774284337.757054, 'last_price_update_time': 1774371213.331554}
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977412') HTTP/1.1" 204 0
2026-03-24 16:53:33 [ayvens.fr] INFO: Found listing with ID: 1977413
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977413%27 HTTP/1.1" 200 None
2026-03-24 16:53:33 [ayvens.fr] INFO: Scrape type for 1977413: 2
2026-03-24 16:53:33 [ayvens.fr] INFO: Extracting data for car ID: 1977413
2026-03-24 16:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef367a6c-3931-597a-a13f-13faa93d04f7 with identifier: 1977413
2026-03-24 16:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef367a6c-3931-597a-a13f-13faa93d04f7 with scrape type 2
2026-03-24 16:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef367a6c-3931-597a-a13f-13faa93d04f7 with scrape type 2
2026-03-24 16:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ef367a6c-3931-597a-a13f-13faa93d04f7, identifier: 1977413
2026-03-24 16:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ef367a6c-3931-597a-a13f-13faa93d04f7 with identifier: 1977413
2026-03-24 16:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ef367a6c-3931-597a-a13f-13faa93d04f7 with identifier: 1977413
2026-03-24 16:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ef367a6c-3931-597a-a13f-13faa93d04f7 with identifier: 1977413 to the API
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'ef367a6c-3931-597a-a13f-13faa93d04f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'OCTAVIA COMBI',
'odometer': 158666,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA OCTAVIA COMBI Octavia Combi 1.5 TSI ACT 150ch Business',
'transmission': 'manual',
'trim': 'Octavia Combi 1.5 TSI ACT 150ch Business',
'vin': None,
'year': 2021}
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977413%27 HTTP/1.1" 200 None
2026-03-24 16:53:33 [ayvens.fr] INFO: Saving data for 1977413: {'auction_closing_time': 1774454400.0, 'created_time': 1774284339.034956, 'last_price_update_time': 1774371213.690728}
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977413') HTTP/1.1" 204 0
2026-03-24 16:53:33 [ayvens.fr] INFO: Found listing with ID: 1977414
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977414%27 HTTP/1.1" 200 None
2026-03-24 16:53:33 [ayvens.fr] INFO: Scrape type for 1977414: 2
2026-03-24 16:53:33 [ayvens.fr] INFO: Extracting data for car ID: 1977414
2026-03-24 16:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ff59d3-551b-5cfb-86c0-f6b9e116d07e with identifier: 1977414
2026-03-24 16:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ff59d3-551b-5cfb-86c0-f6b9e116d07e with scrape type 2
2026-03-24 16:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ff59d3-551b-5cfb-86c0-f6b9e116d07e with scrape type 2
2026-03-24 16:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a9ff59d3-551b-5cfb-86c0-f6b9e116d07e, identifier: 1977414
2026-03-24 16:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a9ff59d3-551b-5cfb-86c0-f6b9e116d07e with identifier: 1977414
2026-03-24 16:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a9ff59d3-551b-5cfb-86c0-f6b9e116d07e with identifier: 1977414
2026-03-24 16:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a9ff59d3-551b-5cfb-86c0-f6b9e116d07e with identifier: 1977414 to the API
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'a9ff59d3-551b-5cfb-86c0-f6b9e116d07e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 142295,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech 145ch Business',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech 145ch Business',
'vin': None,
'year': 2021}
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977414%27 HTTP/1.1" 200 None
2026-03-24 16:53:34 [ayvens.fr] INFO: Saving data for 1977414: {'auction_closing_time': 1774454400.0, 'created_time': 1774284340.644609, 'last_price_update_time': 1774371214.08392}
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977414') HTTP/1.1" 204 0
2026-03-24 16:53:34 [ayvens.fr] INFO: Found listing with ID: 1977415
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977415%27 HTTP/1.1" 200 None
2026-03-24 16:53:34 [ayvens.fr] INFO: Scrape type for 1977415: 2
2026-03-24 16:53:34 [ayvens.fr] INFO: Extracting data for car ID: 1977415
2026-03-24 16:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 286bdf85-be72-54ac-9932-2c7e0222c7dd with identifier: 1977415
2026-03-24 16:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 286bdf85-be72-54ac-9932-2c7e0222c7dd with scrape type 2
2026-03-24 16:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 286bdf85-be72-54ac-9932-2c7e0222c7dd with scrape type 2
2026-03-24 16:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 286bdf85-be72-54ac-9932-2c7e0222c7dd, identifier: 1977415
2026-03-24 16:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 286bdf85-be72-54ac-9932-2c7e0222c7dd with identifier: 1977415
2026-03-24 16:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 286bdf85-be72-54ac-9932-2c7e0222c7dd with identifier: 1977415
2026-03-24 16:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 286bdf85-be72-54ac-9932-2c7e0222c7dd with identifier: 1977415 to the API
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '286bdf85-be72-54ac-9932-2c7e0222c7dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 190881,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 100ch S&S Allure Business',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 100ch S&S Allure Business',
'vin': None,
'year': 2020}
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977415%27 HTTP/1.1" 200 None
2026-03-24 16:53:34 [ayvens.fr] INFO: Saving data for 1977415: {'auction_closing_time': 1774454400.0, 'created_time': 1774284342.711119, 'last_price_update_time': 1774371214.533857}
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977415') HTTP/1.1" 204 0
2026-03-24 16:53:34 [ayvens.fr] INFO: Found listing with ID: 1977416
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977416%27 HTTP/1.1" 200 None
2026-03-24 16:53:34 [ayvens.fr] INFO: Scrape type for 1977416: 2
2026-03-24 16:53:34 [ayvens.fr] INFO: Extracting data for car ID: 1977416
2026-03-24 16:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 035915ed-9444-5b30-b0a8-e4593b51880d with identifier: 1977416
2026-03-24 16:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 035915ed-9444-5b30-b0a8-e4593b51880d with scrape type 2
2026-03-24 16:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 035915ed-9444-5b30-b0a8-e4593b51880d with scrape type 2
2026-03-24 16:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 035915ed-9444-5b30-b0a8-e4593b51880d, identifier: 1977416
2026-03-24 16:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 035915ed-9444-5b30-b0a8-e4593b51880d with identifier: 1977416
2026-03-24 16:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 035915ed-9444-5b30-b0a8-e4593b51880d with identifier: 1977416
2026-03-24 16:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 035915ed-9444-5b30-b0a8-e4593b51880d with identifier: 1977416 to the API
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '035915ed-9444-5b30-b0a8-e4593b51880d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 153899,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977416%27 HTTP/1.1" 200 None
2026-03-24 16:53:34 [ayvens.fr] INFO: Saving data for 1977416: {'auction_closing_time': 1774454400.0, 'created_time': 1774284343.986893, 'last_price_update_time': 1774371214.928157}
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977416') HTTP/1.1" 204 0
2026-03-24 16:53:34 [ayvens.fr] INFO: Found listing with ID: 1977417
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977417%27 HTTP/1.1" 200 None
2026-03-24 16:53:34 [ayvens.fr] INFO: Scrape type for 1977417: 2
2026-03-24 16:53:34 [ayvens.fr] INFO: Extracting data for car ID: 1977417
2026-03-24 16:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23373700-25c6-5b79-b9b1-49d2bb62a827 with identifier: 1977417
2026-03-24 16:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23373700-25c6-5b79-b9b1-49d2bb62a827 with scrape type 2
2026-03-24 16:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23373700-25c6-5b79-b9b1-49d2bb62a827 with scrape type 2
2026-03-24 16:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 23373700-25c6-5b79-b9b1-49d2bb62a827, identifier: 1977417
2026-03-24 16:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 23373700-25c6-5b79-b9b1-49d2bb62a827 with identifier: 1977417
2026-03-24 16:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 23373700-25c6-5b79-b9b1-49d2bb62a827 with identifier: 1977417
2026-03-24 16:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 23373700-25c6-5b79-b9b1-49d2bb62a827 with identifier: 1977417 to the API
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '23373700-25c6-5b79-b9b1-49d2bb62a827',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 186333,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-22',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 2.0 BlueHDi 180ch S&S Asphalt '
'EAT8',
'transmission': 'automatic',
'trim': 'Expert Fg Standard 2.0 BlueHDi 180ch S&S Asphalt EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977417%27 HTTP/1.1" 200 None
2026-03-24 16:53:35 [ayvens.fr] INFO: Saving data for 1977417: {'auction_closing_time': 1774454400.0, 'created_time': 1774284345.413294, 'last_price_update_time': 1774371215.302368}
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977417') HTTP/1.1" 204 0
2026-03-24 16:53:35 [ayvens.fr] INFO: Found listing with ID: 1977418
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977418%27 HTTP/1.1" 200 None
2026-03-24 16:53:35 [ayvens.fr] INFO: Scrape type for 1977418: 2
2026-03-24 16:53:35 [ayvens.fr] INFO: Extracting data for car ID: 1977418
2026-03-24 16:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73 with identifier: 1977418
2026-03-24 16:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73 with scrape type 2
2026-03-24 16:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73 with scrape type 2
2026-03-24 16:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73, identifier: 1977418
2026-03-24 16:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73 with identifier: 1977418
2026-03-24 16:53:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73 with identifier: 1977418
2026-03-24 16:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73 with identifier: 1977418 to the API
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'ROUGE RUBIS METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1ebaf9f7-909e-51b9-a4b0-d058bfa6ee73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 200944,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-26',
'seats_number': 7,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE Tiguan Allspace 2.0 TDI 150ch '
'Confortline Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan Allspace 2.0 TDI 150ch Confortline Business DSG7',
'vin': None,
'year': 2019}
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977418%27 HTTP/1.1" 200 None
2026-03-24 16:53:35 [ayvens.fr] INFO: Saving data for 1977418: {'auction_closing_time': 1774454400.0, 'created_time': 1774284346.956295, 'last_price_update_time': 1774371215.687489}
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977418') HTTP/1.1" 204 0
2026-03-24 16:53:35 [ayvens.fr] INFO: Found listing with ID: 1977419
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977419%27 HTTP/1.1" 200 None
2026-03-24 16:53:35 [ayvens.fr] INFO: Scrape type for 1977419: 2
2026-03-24 16:53:35 [ayvens.fr] INFO: Extracting data for car ID: 1977419
2026-03-24 16:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9 with identifier: 1977419
2026-03-24 16:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9 with scrape type 2
2026-03-24 16:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9 with scrape type 2
2026-03-24 16:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9, identifier: 1977419
2026-03-24 16:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9 with identifier: 1977419
2026-03-24 16:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9 with identifier: 1977419
2026-03-24 16:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9 with identifier: 1977419 to the API
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 156,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'bb5a10ab-4bc1-5d14-9c56-afe7d9e6dfb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'ATECA',
'odometer': 179869,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT ATECA Ateca 1.6 TDI 115ch Start&Stop Style Business Ecomotive '
'DSG',
'transmission': 'automatic',
'trim': 'Ateca 1.6 TDI 115ch Start&Stop Style Business Ecomotive DSG',
'vin': None,
'year': 2020}
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977419%27 HTTP/1.1" 200 None
2026-03-24 16:53:36 [ayvens.fr] INFO: Saving data for 1977419: {'auction_closing_time': 1774454400.0, 'created_time': 1774284348.705326, 'last_price_update_time': 1774371216.04119}
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977419') HTTP/1.1" 204 0
2026-03-24 16:53:36 [ayvens.fr] INFO: Found listing with ID: 1977420
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977420%27 HTTP/1.1" 200 None
2026-03-24 16:53:36 [ayvens.fr] INFO: Scrape type for 1977420: 2
2026-03-24 16:53:36 [ayvens.fr] INFO: Extracting data for car ID: 1977420
2026-03-24 16:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca with identifier: 1977420
2026-03-24 16:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca with scrape type 2
2026-03-24 16:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca with scrape type 2
2026-03-24 16:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca, identifier: 1977420
2026-03-24 16:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca with identifier: 1977420
2026-03-24 16:53:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca with identifier: 1977420
2026-03-24 16:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca with identifier: 1977420 to the API
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'NOIR MAGIC NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '4e5b0824-4d65-57f3-a92b-aa3ac6d0f7ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'KAROQ',
'odometer': 149186,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA KAROQ Karoq 2.0 TDI 116ch SCR Business DSG Euro6ap',
'transmission': 'automatic',
'trim': 'Karoq 2.0 TDI 116ch SCR Business DSG Euro6ap',
'vin': None,
'year': 2021}
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977420%27 HTTP/1.1" 200 None
2026-03-24 16:53:36 [ayvens.fr] INFO: Saving data for 1977420: {'auction_closing_time': 1774454400.0, 'created_time': 1774284352.336406, 'last_price_update_time': 1774371216.42337}
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977420') HTTP/1.1" 204 0
2026-03-24 16:53:36 [ayvens.fr] INFO: Found listing with ID: 1977421
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977421%27 HTTP/1.1" 200 None
2026-03-24 16:53:36 [ayvens.fr] INFO: Scrape type for 1977421: 2
2026-03-24 16:53:36 [ayvens.fr] INFO: Extracting data for car ID: 1977421
2026-03-24 16:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a669dff0-c178-5680-8718-2c07eecdd7f8 with identifier: 1977421
2026-03-24 16:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a669dff0-c178-5680-8718-2c07eecdd7f8 with scrape type 2
2026-03-24 16:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a669dff0-c178-5680-8718-2c07eecdd7f8 with scrape type 2
2026-03-24 16:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a669dff0-c178-5680-8718-2c07eecdd7f8, identifier: 1977421
2026-03-24 16:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a669dff0-c178-5680-8718-2c07eecdd7f8 with identifier: 1977421
2026-03-24 16:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a669dff0-c178-5680-8718-2c07eecdd7f8 with identifier: 1977421
2026-03-24 16:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a669dff0-c178-5680-8718-2c07eecdd7f8 with identifier: 1977421 to the API
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS LUNAIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'a669dff0-c178-5680-8718-2c07eecdd7f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF SW',
'odometer': 157863,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF SW Golf SW 1.0 TSI OPF 110ch Life Business',
'transmission': 'manual',
'trim': 'Golf SW 1.0 TSI OPF 110ch Life Business',
'vin': None,
'year': 2022}
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977421%27 HTTP/1.1" 200 None
2026-03-24 16:53:36 [ayvens.fr] INFO: Saving data for 1977421: {'auction_closing_time': 1774454400.0, 'created_time': 1774284353.53406, 'last_price_update_time': 1774371216.77556}
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977421') HTTP/1.1" 204 0
2026-03-24 16:53:36 [ayvens.fr] INFO: Found listing with ID: 1977422
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977422%27 HTTP/1.1" 200 None
2026-03-24 16:53:36 [ayvens.fr] INFO: Scrape type for 1977422: 2
2026-03-24 16:53:36 [ayvens.fr] INFO: Extracting data for car ID: 1977422
2026-03-24 16:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18342dd2-a120-5e20-bbe2-614ad921e1e8 with identifier: 1977422
2026-03-24 16:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18342dd2-a120-5e20-bbe2-614ad921e1e8 with scrape type 2
2026-03-24 16:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18342dd2-a120-5e20-bbe2-614ad921e1e8 with scrape type 2
2026-03-24 16:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 18342dd2-a120-5e20-bbe2-614ad921e1e8, identifier: 1977422
2026-03-24 16:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 18342dd2-a120-5e20-bbe2-614ad921e1e8 with identifier: 1977422
2026-03-24 16:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 18342dd2-a120-5e20-bbe2-614ad921e1e8 with identifier: 1977422
2026-03-24 16:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 18342dd2-a120-5e20-bbe2-614ad921e1e8 with identifier: 1977422 to the API
2026-03-24 16:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '18342dd2-a120-5e20-bbe2-614ad921e1e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 157299,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-08',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977422%27 HTTP/1.1" 200 None
2026-03-24 16:53:37 [ayvens.fr] INFO: Saving data for 1977422: {'auction_closing_time': 1774454400.0, 'created_time': 1774284354.894724, 'last_price_update_time': 1774371217.130868}
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977422') HTTP/1.1" 204 0
2026-03-24 16:53:37 [ayvens.fr] INFO: Found listing with ID: 1977423
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977423%27 HTTP/1.1" 200 None
2026-03-24 16:53:37 [ayvens.fr] INFO: Scrape type for 1977423: 2
2026-03-24 16:53:37 [ayvens.fr] INFO: Extracting data for car ID: 1977423
2026-03-24 16:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bdbda71-1401-5797-a4cc-c72d689930b5 with identifier: 1977423
2026-03-24 16:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bdbda71-1401-5797-a4cc-c72d689930b5 with scrape type 2
2026-03-24 16:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bdbda71-1401-5797-a4cc-c72d689930b5 with scrape type 2
2026-03-24 16:53:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8bdbda71-1401-5797-a4cc-c72d689930b5, identifier: 1977423
2026-03-24 16:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8bdbda71-1401-5797-a4cc-c72d689930b5 with identifier: 1977423
2026-03-24 16:53:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8bdbda71-1401-5797-a4cc-c72d689930b5 with identifier: 1977423
2026-03-24 16:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8bdbda71-1401-5797-a4cc-c72d689930b5 with identifier: 1977423 to the API
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'ACIER BI',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8bdbda71-1401-5797-a4cc-c72d689930b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 199146,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 Hybride 218ch Collection 2WD',
'transmission': 'automatic',
'trim': 'RAV4 Hybride 218ch Collection 2WD',
'vin': None,
'year': 2021}
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977423%27 HTTP/1.1" 200 None
2026-03-24 16:53:37 [ayvens.fr] INFO: Saving data for 1977423: {'auction_closing_time': 1774454400.0, 'created_time': 1774284356.615259, 'last_price_update_time': 1774371217.500923}
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977423') HTTP/1.1" 204 0
2026-03-24 16:53:37 [ayvens.fr] INFO: Found listing with ID: 1977424
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977424%27 HTTP/1.1" 200 None
2026-03-24 16:53:37 [ayvens.fr] INFO: Scrape type for 1977424: 2
2026-03-24 16:53:37 [ayvens.fr] INFO: Extracting data for car ID: 1977424
2026-03-24 16:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b24d7e97-3ffd-523a-904e-628d765b3188 with identifier: 1977424
2026-03-24 16:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b24d7e97-3ffd-523a-904e-628d765b3188 with scrape type 2
2026-03-24 16:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b24d7e97-3ffd-523a-904e-628d765b3188 with scrape type 2
2026-03-24 16:53:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b24d7e97-3ffd-523a-904e-628d765b3188, identifier: 1977424
2026-03-24 16:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b24d7e97-3ffd-523a-904e-628d765b3188 with identifier: 1977424
2026-03-24 16:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b24d7e97-3ffd-523a-904e-628d765b3188 with identifier: 1977424
2026-03-24 16:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b24d7e97-3ffd-523a-904e-628d765b3188 with identifier: 1977424 to the API
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'b24d7e97-3ffd-523a-904e-628d765b3188',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 152386,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch S&S Active Business',
'vin': None,
'year': 2022}
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977424%27 HTTP/1.1" 200 None
2026-03-24 16:53:37 [ayvens.fr] INFO: Saving data for 1977424: {'auction_closing_time': 1774454400.0, 'created_time': 1774284358.492883, 'last_price_update_time': 1774371217.943661}
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977424') HTTP/1.1" 204 0
2026-03-24 16:53:37 [ayvens.fr] INFO: Found listing with ID: 1977425
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977425%27 HTTP/1.1" 200 None
2026-03-24 16:53:37 [ayvens.fr] INFO: Scrape type for 1977425: 2
2026-03-24 16:53:37 [ayvens.fr] INFO: Extracting data for car ID: 1977425
2026-03-24 16:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35adc17-e457-5bc4-9281-30d611c5a81c with identifier: 1977425
2026-03-24 16:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35adc17-e457-5bc4-9281-30d611c5a81c with scrape type 2
2026-03-24 16:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d35adc17-e457-5bc4-9281-30d611c5a81c with scrape type 2
2026-03-24 16:53:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d35adc17-e457-5bc4-9281-30d611c5a81c, identifier: 1977425
2026-03-24 16:53:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d35adc17-e457-5bc4-9281-30d611c5a81c with identifier: 1977425
2026-03-24 16:53:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d35adc17-e457-5bc4-9281-30d611c5a81c with identifier: 1977425
2026-03-24 16:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d35adc17-e457-5bc4-9281-30d611c5a81c with identifier: 1977425 to the API
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'd35adc17-e457-5bc4-9281-30d611c5a81c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 141933,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A3 SPORTBACK A3 Sportback 35 TDI 150ch S line S tronic 7',
'transmission': 'automatic',
'trim': 'A3 Sportback 35 TDI 150ch S line S tronic 7',
'vin': None,
'year': 2022}
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977425%27 HTTP/1.1" 200 None
2026-03-24 16:53:38 [ayvens.fr] INFO: Saving data for 1977425: {'auction_closing_time': 1774454400.0, 'created_time': 1774284359.171502, 'last_price_update_time': 1774371218.312681}
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977425') HTTP/1.1" 204 0
2026-03-24 16:53:38 [ayvens.fr] INFO: Found listing with ID: 1977426
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977426%27 HTTP/1.1" 200 None
2026-03-24 16:53:38 [ayvens.fr] INFO: Scrape type for 1977426: 2
2026-03-24 16:53:38 [ayvens.fr] INFO: Extracting data for car ID: 1977426
2026-03-24 16:53:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c655265b-7505-5372-b2e5-40af36bc40b7 with identifier: 1977426
2026-03-24 16:53:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c655265b-7505-5372-b2e5-40af36bc40b7 with scrape type 2
2026-03-24 16:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c655265b-7505-5372-b2e5-40af36bc40b7 with scrape type 2
2026-03-24 16:53:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c655265b-7505-5372-b2e5-40af36bc40b7, identifier: 1977426
2026-03-24 16:53:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c655265b-7505-5372-b2e5-40af36bc40b7 with identifier: 1977426
2026-03-24 16:53:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c655265b-7505-5372-b2e5-40af36bc40b7 with identifier: 1977426
2026-03-24 16:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c655265b-7505-5372-b2e5-40af36bc40b7 with identifier: 1977426 to the API
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c655265b-7505-5372-b2e5-40af36bc40b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 152481,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Tech Edition',
'transmission': 'manual',
'trim': '308 1.5 BlueHDi 130ch S&S Tech Edition',
'vin': None,
'year': 2020}
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977426%27 HTTP/1.1" 200 None
2026-03-24 16:53:38 [ayvens.fr] INFO: Saving data for 1977426: {'auction_closing_time': 1774454400.0, 'created_time': 1774284360.50273, 'last_price_update_time': 1774371218.750232}
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977426') HTTP/1.1" 204 0
2026-03-24 16:53:38 [ayvens.fr] INFO: Found listing with ID: 1977427
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977427%27 HTTP/1.1" 200 None
2026-03-24 16:53:38 [ayvens.fr] INFO: Scrape type for 1977427: 2
2026-03-24 16:53:38 [ayvens.fr] INFO: Extracting data for car ID: 1977427
2026-03-24 16:53:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0 with identifier: 1977427
2026-03-24 16:53:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0 with scrape type 2
2026-03-24 16:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0 with scrape type 2
2026-03-24 16:53:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0, identifier: 1977427
2026-03-24 16:53:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0 with identifier: 1977427
2026-03-24 16:53:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0 with identifier: 1977427
2026-03-24 16:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0 with identifier: 1977427 to the API
2026-03-24 16:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 189,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a0bf6bec-bfe8-5c5d-a4a3-459558ba98b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 187748,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt',
'vin': None,
'year': 2021}
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977427%27 HTTP/1.1" 200 None
2026-03-24 16:53:39 [ayvens.fr] INFO: Saving data for 1977427: {'auction_closing_time': 1774454400.0, 'created_time': 1774284362.094979, 'last_price_update_time': 1774371219.103516}
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977427') HTTP/1.1" 204 0
2026-03-24 16:53:39 [ayvens.fr] INFO: Found listing with ID: 1977428
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977428%27 HTTP/1.1" 200 None
2026-03-24 16:53:39 [ayvens.fr] INFO: Scrape type for 1977428: 2
2026-03-24 16:53:39 [ayvens.fr] INFO: Extracting data for car ID: 1977428
2026-03-24 16:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a6b8471-e61d-54ae-a760-1fb18ba86061 with identifier: 1977428
2026-03-24 16:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a6b8471-e61d-54ae-a760-1fb18ba86061 with scrape type 2
2026-03-24 16:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a6b8471-e61d-54ae-a760-1fb18ba86061 with scrape type 2
2026-03-24 16:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0a6b8471-e61d-54ae-a760-1fb18ba86061, identifier: 1977428
2026-03-24 16:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0a6b8471-e61d-54ae-a760-1fb18ba86061 with identifier: 1977428
2026-03-24 16:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0a6b8471-e61d-54ae-a760-1fb18ba86061 with identifier: 1977428
2026-03-24 16:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0a6b8471-e61d-54ae-a760-1fb18ba86061 with identifier: 1977428 to the API
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 164,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0a6b8471-e61d-54ae-a760-1fb18ba86061',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 146871,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 2.0 BlueHDi 180ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '5008 2.0 BlueHDi 180ch S&S GT EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977428%27 HTTP/1.1" 200 None
2026-03-24 16:53:39 [ayvens.fr] INFO: Saving data for 1977428: {'auction_closing_time': 1774454400.0, 'created_time': 1774284363.456987, 'last_price_update_time': 1774371219.457672}
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977428') HTTP/1.1" 204 0
2026-03-24 16:53:39 [ayvens.fr] INFO: Found listing with ID: 1977429
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977429%27 HTTP/1.1" 200 None
2026-03-24 16:53:39 [ayvens.fr] INFO: Scrape type for 1977429: 2
2026-03-24 16:53:39 [ayvens.fr] INFO: Extracting data for car ID: 1977429
2026-03-24 16:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a444b9-dccd-56b9-864e-7ffa0037e726 with identifier: 1977429
2026-03-24 16:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a444b9-dccd-56b9-864e-7ffa0037e726 with scrape type 2
2026-03-24 16:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a444b9-dccd-56b9-864e-7ffa0037e726 with scrape type 2
2026-03-24 16:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 38a444b9-dccd-56b9-864e-7ffa0037e726, identifier: 1977429
2026-03-24 16:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 38a444b9-dccd-56b9-864e-7ffa0037e726 with identifier: 1977429
2026-03-24 16:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 38a444b9-dccd-56b9-864e-7ffa0037e726 with identifier: 1977429
2026-03-24 16:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 38a444b9-dccd-56b9-864e-7ffa0037e726 with identifier: 1977429 to the API
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '38a444b9-dccd-56b9-864e-7ffa0037e726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'ASTRA',
'odometer': 147308,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL ASTRA Astra Sports Tourer 1.5 D 122ch Elegance Business',
'transmission': 'manual',
'trim': 'Astra Sports Tourer 1.5 D 122ch Elegance Business',
'vin': None,
'year': 2022}
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977429%27 HTTP/1.1" 200 None
2026-03-24 16:53:39 [ayvens.fr] INFO: Saving data for 1977429: {'auction_closing_time': 1774454400.0, 'created_time': 1774284365.315011, 'last_price_update_time': 1774371219.842015}
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977429') HTTP/1.1" 204 0
2026-03-24 16:53:39 [ayvens.fr] INFO: Found listing with ID: 1977430
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977430%27 HTTP/1.1" 200 None
2026-03-24 16:53:39 [ayvens.fr] INFO: Scrape type for 1977430: 2
2026-03-24 16:53:39 [ayvens.fr] INFO: Extracting data for car ID: 1977430
2026-03-24 16:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db605208-2c65-5e56-89a3-184e30f1abbd with identifier: 1977430
2026-03-24 16:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db605208-2c65-5e56-89a3-184e30f1abbd with scrape type 2
2026-03-24 16:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db605208-2c65-5e56-89a3-184e30f1abbd with scrape type 2
2026-03-24 16:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: db605208-2c65-5e56-89a3-184e30f1abbd, identifier: 1977430
2026-03-24 16:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: db605208-2c65-5e56-89a3-184e30f1abbd with identifier: 1977430
2026-03-24 16:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: db605208-2c65-5e56-89a3-184e30f1abbd with identifier: 1977430
2026-03-24 16:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: db605208-2c65-5e56-89a3-184e30f1abbd with identifier: 1977430 to the API
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'db605208-2c65-5e56-89a3-184e30f1abbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 143824,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-16',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S Feel Nav',
'vin': None,
'year': 2021}
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977430%27 HTTP/1.1" 200 None
2026-03-24 16:53:40 [ayvens.fr] INFO: Saving data for 1977430: {'auction_closing_time': 1774454400.0, 'created_time': 1774284367.666205, 'last_price_update_time': 1774371220.326369}
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977430') HTTP/1.1" 204 0
2026-03-24 16:53:40 [ayvens.fr] INFO: Found listing with ID: 1977431
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977431%27 HTTP/1.1" 200 None
2026-03-24 16:53:40 [ayvens.fr] INFO: Scrape type for 1977431: 2
2026-03-24 16:53:40 [ayvens.fr] INFO: Extracting data for car ID: 1977431
2026-03-24 16:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed26ff21-12a2-560f-8672-27729d4863b4 with identifier: 1977431
2026-03-24 16:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed26ff21-12a2-560f-8672-27729d4863b4 with scrape type 2
2026-03-24 16:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed26ff21-12a2-560f-8672-27729d4863b4 with scrape type 2
2026-03-24 16:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ed26ff21-12a2-560f-8672-27729d4863b4, identifier: 1977431
2026-03-24 16:53:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ed26ff21-12a2-560f-8672-27729d4863b4 with identifier: 1977431
2026-03-24 16:53:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ed26ff21-12a2-560f-8672-27729d4863b4 with identifier: 1977431
2026-03-24 16:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ed26ff21-12a2-560f-8672-27729d4863b4 with identifier: 1977431 to the API
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'GRIS GRAPHITE M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'ed26ff21-12a2-560f-8672-27729d4863b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'KODIAQ',
'odometer': 146125,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA KODIAQ Kodiaq 2.0 TDI 150ch SCR Sportline DSG7 5 places',
'transmission': 'automatic',
'trim': 'Kodiaq 2.0 TDI 150ch SCR Sportline DSG7 5 places',
'vin': None,
'year': 2022}
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977431%27 HTTP/1.1" 200 None
2026-03-24 16:53:41 [ayvens.fr] INFO: Saving data for 1977431: {'auction_closing_time': 1774454400.0, 'created_time': 1774284368.489905, 'last_price_update_time': 1774371221.022037}
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977431') HTTP/1.1" 204 0
2026-03-24 16:53:41 [ayvens.fr] INFO: Found listing with ID: 1977432
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977432%27 HTTP/1.1" 200 None
2026-03-24 16:53:41 [ayvens.fr] INFO: Scrape type for 1977432: 2
2026-03-24 16:53:41 [ayvens.fr] INFO: Extracting data for car ID: 1977432
2026-03-24 16:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40eb3989-c6cf-53c8-a646-9b0c40e8ca05 with identifier: 1977432
2026-03-24 16:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40eb3989-c6cf-53c8-a646-9b0c40e8ca05 with scrape type 2
2026-03-24 16:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40eb3989-c6cf-53c8-a646-9b0c40e8ca05 with scrape type 2
2026-03-24 16:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 40eb3989-c6cf-53c8-a646-9b0c40e8ca05, identifier: 1977432
2026-03-24 16:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 40eb3989-c6cf-53c8-a646-9b0c40e8ca05 with identifier: 1977432
2026-03-24 16:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 40eb3989-c6cf-53c8-a646-9b0c40e8ca05 with identifier: 1977432
2026-03-24 16:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 40eb3989-c6cf-53c8-a646-9b0c40e8ca05 with identifier: 1977432 to the API
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '40eb3989-c6cf-53c8-a646-9b0c40e8ca05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 156652,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-05',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 208 208 Affaire 1.5 BlueHDi 100 Premium',
'transmission': 'manual',
'trim': '208 Affaire 1.5 BlueHDi 100 Premium',
'vin': None,
'year': 2022}
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977432%27 HTTP/1.1" 200 None
2026-03-24 16:53:41 [ayvens.fr] INFO: Saving data for 1977432: {'auction_closing_time': 1774454400.0, 'created_time': 1774284370.234905, 'last_price_update_time': 1774371221.393246}
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977432') HTTP/1.1" 204 0
2026-03-24 16:53:41 [ayvens.fr] INFO: Found listing with ID: 1977433
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977433%27 HTTP/1.1" 200 None
2026-03-24 16:53:41 [ayvens.fr] INFO: Scrape type for 1977433: 2
2026-03-24 16:53:41 [ayvens.fr] INFO: Extracting data for car ID: 1977433
2026-03-24 16:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb896f3-2edb-5d68-a4de-80e223456426 with identifier: 1977433
2026-03-24 16:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb896f3-2edb-5d68-a4de-80e223456426 with scrape type 2
2026-03-24 16:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afb896f3-2edb-5d68-a4de-80e223456426 with scrape type 2
2026-03-24 16:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: afb896f3-2edb-5d68-a4de-80e223456426, identifier: 1977433
2026-03-24 16:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: afb896f3-2edb-5d68-a4de-80e223456426 with identifier: 1977433
2026-03-24 16:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: afb896f3-2edb-5d68-a4de-80e223456426 with identifier: 1977433
2026-03-24 16:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: afb896f3-2edb-5d68-a4de-80e223456426 with identifier: 1977433 to the API
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'GRIS AMAZONITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'afb896f3-2edb-5d68-a4de-80e223456426',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 147479,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-03',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977433%27 HTTP/1.1" 200 None
2026-03-24 16:53:41 [ayvens.fr] INFO: Saving data for 1977433: {'auction_closing_time': 1774454400.0, 'created_time': 1774284371.519084, 'last_price_update_time': 1774371221.745211}
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977433') HTTP/1.1" 204 0
2026-03-24 16:53:41 [ayvens.fr] INFO: Found listing with ID: 1977434
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977434%27 HTTP/1.1" 200 None
2026-03-24 16:53:41 [ayvens.fr] INFO: Scrape type for 1977434: 2
2026-03-24 16:53:41 [ayvens.fr] INFO: Extracting data for car ID: 1977434
2026-03-24 16:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b403aba5-a2cb-5fde-af2d-b63812e7362d with identifier: 1977434
2026-03-24 16:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b403aba5-a2cb-5fde-af2d-b63812e7362d with scrape type 2
2026-03-24 16:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b403aba5-a2cb-5fde-af2d-b63812e7362d with scrape type 2
2026-03-24 16:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b403aba5-a2cb-5fde-af2d-b63812e7362d, identifier: 1977434
2026-03-24 16:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b403aba5-a2cb-5fde-af2d-b63812e7362d with identifier: 1977434
2026-03-24 16:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b403aba5-a2cb-5fde-af2d-b63812e7362d with identifier: 1977434
2026-03-24 16:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b403aba5-a2cb-5fde-af2d-b63812e7362d with identifier: 1977434 to the API
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'b403aba5-a2cb-5fde-af2d-b63812e7362d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 GRAN TOURER',
'odometer': 148576,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-12',
'seats_number': 7,
'seller_name': None,
'title': 'BMW SERIE 2 GRAN TOURER Serie 2 Gran Tourer 218iA 136ch Business '
'Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 2 Gran Tourer 218iA 136ch Business Design DKG7',
'vin': None,
'year': 2022}
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977434%27 HTTP/1.1" 200 None
2026-03-24 16:53:42 [ayvens.fr] INFO: Saving data for 1977434: {'auction_closing_time': 1774454400.0, 'created_time': 1774284373.566539, 'last_price_update_time': 1774371222.108124}
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977434') HTTP/1.1" 204 0
2026-03-24 16:53:42 [ayvens.fr] INFO: Found listing with ID: 1977435
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977435%27 HTTP/1.1" 200 None
2026-03-24 16:53:42 [ayvens.fr] INFO: Scrape type for 1977435: 2
2026-03-24 16:53:42 [ayvens.fr] INFO: Extracting data for car ID: 1977435
2026-03-24 16:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88883290-8e2c-54d7-b158-c95ccbd74079 with identifier: 1977435
2026-03-24 16:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88883290-8e2c-54d7-b158-c95ccbd74079 with scrape type 2
2026-03-24 16:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88883290-8e2c-54d7-b158-c95ccbd74079 with scrape type 2
2026-03-24 16:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 88883290-8e2c-54d7-b158-c95ccbd74079, identifier: 1977435
2026-03-24 16:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 88883290-8e2c-54d7-b158-c95ccbd74079 with identifier: 1977435
2026-03-24 16:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 88883290-8e2c-54d7-b158-c95ccbd74079 with identifier: 1977435
2026-03-24 16:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 88883290-8e2c-54d7-b158-c95ccbd74079 with identifier: 1977435 to the API
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': 'NOIR INTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '88883290-8e2c-54d7-b158-c95ccbd74079',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 157081,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-13',
'seats_number': 7,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE Tiguan Allspace 2.0 TDI 150ch Life '
'Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan Allspace 2.0 TDI 150ch Life Business DSG7',
'vin': None,
'year': 2022}
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977435%27 HTTP/1.1" 200 None
2026-03-24 16:53:42 [ayvens.fr] INFO: Saving data for 1977435: {'auction_closing_time': 1774454400.0, 'created_time': 1774284374.846016, 'last_price_update_time': 1774371222.46643}
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977435') HTTP/1.1" 204 0
2026-03-24 16:53:42 [ayvens.fr] INFO: Found listing with ID: 1977436
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977436%27 HTTP/1.1" 200 None
2026-03-24 16:53:42 [ayvens.fr] INFO: Scrape type for 1977436: 2
2026-03-24 16:53:42 [ayvens.fr] INFO: Extracting data for car ID: 1977436
2026-03-24 16:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e043d672-d678-5c87-80c8-7feca9b9b498 with identifier: 1977436
2026-03-24 16:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e043d672-d678-5c87-80c8-7feca9b9b498 with scrape type 2
2026-03-24 16:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e043d672-d678-5c87-80c8-7feca9b9b498 with scrape type 2
2026-03-24 16:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e043d672-d678-5c87-80c8-7feca9b9b498, identifier: 1977436
2026-03-24 16:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e043d672-d678-5c87-80c8-7feca9b9b498 with identifier: 1977436
2026-03-24 16:53:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e043d672-d678-5c87-80c8-7feca9b9b498 with identifier: 1977436
2026-03-24 16:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e043d672-d678-5c87-80c8-7feca9b9b498 with identifier: 1977436 to the API
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': 'BLANC CRYSTAL METALISS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'e043d672-d678-5c87-80c8-7feca9b9b498',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 164120,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Utimate Style Dark Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Utimate Style Dark Geartronic',
'vin': None,
'year': 2022}
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977436%27 HTTP/1.1" 200 None
2026-03-24 16:53:42 [ayvens.fr] INFO: Saving data for 1977436: {'auction_closing_time': 1774454400.0, 'created_time': 1774284376.181772, 'last_price_update_time': 1774371222.850998}
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977436') HTTP/1.1" 204 0
2026-03-24 16:53:42 [ayvens.fr] INFO: Found listing with ID: 1977437
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977437%27 HTTP/1.1" 200 None
2026-03-24 16:53:42 [ayvens.fr] INFO: Scrape type for 1977437: 2
2026-03-24 16:53:42 [ayvens.fr] INFO: Extracting data for car ID: 1977437
2026-03-24 16:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925d6593-a28f-5b3d-9d89-bb3ab559d70e with identifier: 1977437
2026-03-24 16:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925d6593-a28f-5b3d-9d89-bb3ab559d70e with scrape type 2
2026-03-24 16:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 925d6593-a28f-5b3d-9d89-bb3ab559d70e with scrape type 2
2026-03-24 16:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 925d6593-a28f-5b3d-9d89-bb3ab559d70e, identifier: 1977437
2026-03-24 16:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 925d6593-a28f-5b3d-9d89-bb3ab559d70e with identifier: 1977437
2026-03-24 16:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 925d6593-a28f-5b3d-9d89-bb3ab559d70e with identifier: 1977437
2026-03-24 16:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 925d6593-a28f-5b3d-9d89-bb3ab559d70e with identifier: 1977437 to the API
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '925d6593-a28f-5b3d-9d89-bb3ab559d70e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 155257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-14',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express Maxi 1.5 Blue dCi 95ch Grand '
'Volume Extra R-Link',
'transmission': 'manual',
'trim': 'Kangoo Express Maxi 1.5 Blue dCi 95ch Grand Volume Extra R-Link',
'vin': None,
'year': 2021}
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977437%27 HTTP/1.1" 200 None
2026-03-24 16:53:43 [ayvens.fr] INFO: Saving data for 1977437: {'auction_closing_time': 1774454400.0, 'created_time': 1774284377.680181, 'last_price_update_time': 1774371223.343713}
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977437') HTTP/1.1" 204 0
2026-03-24 16:53:43 [ayvens.fr] INFO: Found listing with ID: 1977438
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977438%27 HTTP/1.1" 200 None
2026-03-24 16:53:43 [ayvens.fr] INFO: Scrape type for 1977438: 2
2026-03-24 16:53:43 [ayvens.fr] INFO: Extracting data for car ID: 1977438
2026-03-24 16:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dce793b-60bb-5305-97d1-bcc879ff5665 with identifier: 1977438
2026-03-24 16:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dce793b-60bb-5305-97d1-bcc879ff5665 with scrape type 2
2026-03-24 16:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dce793b-60bb-5305-97d1-bcc879ff5665 with scrape type 2
2026-03-24 16:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9dce793b-60bb-5305-97d1-bcc879ff5665, identifier: 1977438
2026-03-24 16:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9dce793b-60bb-5305-97d1-bcc879ff5665 with identifier: 1977438
2026-03-24 16:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9dce793b-60bb-5305-97d1-bcc879ff5665 with identifier: 1977438
2026-03-24 16:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9dce793b-60bb-5305-97d1-bcc879ff5665 with identifier: 1977438 to the API
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC PERLE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.5L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'electric',
'id': '9dce793b-60bb-5305-97d1-bcc879ff5665',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 141150,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Long-Range Dual Motor AWD',
'transmission': 'automatic',
'trim': 'Model 3 Long-Range Dual Motor AWD',
'vin': None,
'year': 2021}
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977438%27 HTTP/1.1" 200 None
2026-03-24 16:53:43 [ayvens.fr] INFO: Saving data for 1977438: {'auction_closing_time': 1774454400.0, 'created_time': 1774284378.922006, 'last_price_update_time': 1774371223.706077}
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977438') HTTP/1.1" 204 0
2026-03-24 16:53:43 [ayvens.fr] INFO: Found listing with ID: 1977439
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977439%27 HTTP/1.1" 200 None
2026-03-24 16:53:43 [ayvens.fr] INFO: Scrape type for 1977439: 2
2026-03-24 16:53:43 [ayvens.fr] INFO: Extracting data for car ID: 1977439
2026-03-24 16:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c6062c-bcdf-53b4-8400-969e2b462896 with identifier: 1977439
2026-03-24 16:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c6062c-bcdf-53b4-8400-969e2b462896 with scrape type 2
2026-03-24 16:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c6062c-bcdf-53b4-8400-969e2b462896 with scrape type 2
2026-03-24 16:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b2c6062c-bcdf-53b4-8400-969e2b462896, identifier: 1977439
2026-03-24 16:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b2c6062c-bcdf-53b4-8400-969e2b462896 with identifier: 1977439
2026-03-24 16:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b2c6062c-bcdf-53b4-8400-969e2b462896 with identifier: 1977439
2026-03-24 16:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b2c6062c-bcdf-53b4-8400-969e2b462896 with identifier: 1977439 to the API
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b2c6062c-bcdf-53b4-8400-969e2b462896',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA TS',
'odometer': 158548,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA TS Corolla Touring Spt 184h Collection',
'transmission': 'automatic',
'trim': 'Corolla Touring Spt 184h Collection',
'vin': None,
'year': 2021}
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977439%27 HTTP/1.1" 200 None
2026-03-24 16:53:44 [ayvens.fr] INFO: Saving data for 1977439: {'auction_closing_time': 1774454400.0, 'created_time': 1774284381.144859, 'last_price_update_time': 1774371224.126605}
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977439') HTTP/1.1" 204 0
2026-03-24 16:53:44 [ayvens.fr] INFO: Found listing with ID: 1977440
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977440%27 HTTP/1.1" 200 None
2026-03-24 16:53:44 [ayvens.fr] INFO: Scrape type for 1977440: 2
2026-03-24 16:53:44 [ayvens.fr] INFO: Extracting data for car ID: 1977440
2026-03-24 16:53:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c081c58a-a0b1-51c3-8ff4-5d86ff88b582 with identifier: 1977440
2026-03-24 16:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c081c58a-a0b1-51c3-8ff4-5d86ff88b582 with scrape type 2
2026-03-24 16:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c081c58a-a0b1-51c3-8ff4-5d86ff88b582 with scrape type 2
2026-03-24 16:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c081c58a-a0b1-51c3-8ff4-5d86ff88b582, identifier: 1977440
2026-03-24 16:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c081c58a-a0b1-51c3-8ff4-5d86ff88b582 with identifier: 1977440
2026-03-24 16:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c081c58a-a0b1-51c3-8ff4-5d86ff88b582 with identifier: 1977440
2026-03-24 16:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c081c58a-a0b1-51c3-8ff4-5d86ff88b582 with identifier: 1977440 to the API
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'NOIR ONYX',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c081c58a-a0b1-51c3-8ff4-5d86ff88b582',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 SPACETOURER',
'odometer': 208391,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-19',
'seats_number': 7,
'seller_name': None,
'title': 'CITROËN C4 SPACETOURER Grand C4 SpaceTourer BlueHDi 130ch S&S '
'Business EAT8',
'transmission': 'automatic',
'trim': 'Grand C4 SpaceTourer BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977440%27 HTTP/1.1" 200 None
2026-03-24 16:53:44 [ayvens.fr] INFO: Saving data for 1977440: {'auction_closing_time': 1774454400.0, 'created_time': 1774284382.317119, 'last_price_update_time': 1774371224.511135}
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977440') HTTP/1.1" 204 0
2026-03-24 16:53:44 [ayvens.fr] INFO: Found listing with ID: 1977441
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977441%27 HTTP/1.1" 200 None
2026-03-24 16:53:44 [ayvens.fr] INFO: Scrape type for 1977441: 2
2026-03-24 16:53:44 [ayvens.fr] INFO: Extracting data for car ID: 1977441
2026-03-24 16:53:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7672ca87-0a91-5e93-9277-f1749f1b2b47 with identifier: 1977441
2026-03-24 16:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7672ca87-0a91-5e93-9277-f1749f1b2b47 with scrape type 2
2026-03-24 16:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7672ca87-0a91-5e93-9277-f1749f1b2b47 with scrape type 2
2026-03-24 16:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7672ca87-0a91-5e93-9277-f1749f1b2b47, identifier: 1977441
2026-03-24 16:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7672ca87-0a91-5e93-9277-f1749f1b2b47 with identifier: 1977441
2026-03-24 16:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7672ca87-0a91-5e93-9277-f1749f1b2b47 with identifier: 1977441
2026-03-24 16:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7672ca87-0a91-5e93-9277-f1749f1b2b47 with identifier: 1977441 to the API
2026-03-24 16:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '7672ca87-0a91-5e93-9277-f1749f1b2b47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 158121,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 CRDI 136ch Hybrid 48V Business DCT7',
'transmission': 'automatic',
'trim': 'Tucson 1.6 CRDI 136ch Hybrid 48V Business DCT7',
'vin': None,
'year': 2023}
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977441%27 HTTP/1.1" 200 None
2026-03-24 16:53:45 [ayvens.fr] INFO: Saving data for 1977441: {'auction_closing_time': 1774454400.0, 'created_time': 1774284383.74829, 'last_price_update_time': 1774371225.128323}
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977441') HTTP/1.1" 204 0
2026-03-24 16:53:45 [ayvens.fr] INFO: Found listing with ID: 1977442
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977442%27 HTTP/1.1" 200 None
2026-03-24 16:53:45 [ayvens.fr] INFO: Scrape type for 1977442: 2
2026-03-24 16:53:45 [ayvens.fr] INFO: Extracting data for car ID: 1977442
2026-03-24 16:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f254622-88f1-5a66-9e74-4bcd4479c55a with identifier: 1977442
2026-03-24 16:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f254622-88f1-5a66-9e74-4bcd4479c55a with scrape type 2
2026-03-24 16:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f254622-88f1-5a66-9e74-4bcd4479c55a with scrape type 2
2026-03-24 16:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8f254622-88f1-5a66-9e74-4bcd4479c55a, identifier: 1977442
2026-03-24 16:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8f254622-88f1-5a66-9e74-4bcd4479c55a with identifier: 1977442
2026-03-24 16:53:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8f254622-88f1-5a66-9e74-4bcd4479c55a with identifier: 1977442
2026-03-24 16:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8f254622-88f1-5a66-9e74-4bcd4479c55a with identifier: 1977442 to the API
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'METALLIC COPPER M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '8f254622-88f1-5a66-9e74-4bcd4479c55a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 174234,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Allure EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977442%27 HTTP/1.1" 200 None
2026-03-24 16:53:45 [ayvens.fr] INFO: Saving data for 1977442: {'auction_closing_time': 1774454400.0, 'created_time': 1774284385.24602, 'last_price_update_time': 1774371225.632886}
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977442') HTTP/1.1" 204 0
2026-03-24 16:53:45 [ayvens.fr] INFO: Found listing with ID: 1977443
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977443%27 HTTP/1.1" 200 None
2026-03-24 16:53:45 [ayvens.fr] INFO: Scrape type for 1977443: 2
2026-03-24 16:53:45 [ayvens.fr] INFO: Extracting data for car ID: 1977443
2026-03-24 16:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5307c3-e8b7-5428-a55e-30ce5b586e39 with identifier: 1977443
2026-03-24 16:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5307c3-e8b7-5428-a55e-30ce5b586e39 with scrape type 2
2026-03-24 16:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5307c3-e8b7-5428-a55e-30ce5b586e39 with scrape type 2
2026-03-24 16:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ee5307c3-e8b7-5428-a55e-30ce5b586e39, identifier: 1977443
2026-03-24 16:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ee5307c3-e8b7-5428-a55e-30ce5b586e39 with identifier: 1977443
2026-03-24 16:53:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ee5307c3-e8b7-5428-a55e-30ce5b586e39 with identifier: 1977443
2026-03-24 16:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ee5307c3-e8b7-5428-a55e-30ce5b586e39 with identifier: 1977443 to the API
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': 'BLEU TIJUCA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'ee5307c3-e8b7-5428-a55e-30ce5b586e39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 154369,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid 225ch Shine e-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid 225ch Shine e-EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977443%27 HTTP/1.1" 200 None
2026-03-24 16:53:46 [ayvens.fr] INFO: Saving data for 1977443: {'auction_closing_time': 1774454400.0, 'created_time': 1774284386.620573, 'last_price_update_time': 1774371226.060324}
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977443') HTTP/1.1" 204 0
2026-03-24 16:53:46 [ayvens.fr] INFO: Found listing with ID: 1977444
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977444%27 HTTP/1.1" 200 None
2026-03-24 16:53:46 [ayvens.fr] INFO: Scrape type for 1977444: 2
2026-03-24 16:53:46 [ayvens.fr] INFO: Extracting data for car ID: 1977444
2026-03-24 16:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52252f1a-9213-5cb2-bcc8-b0a93fb4f145 with identifier: 1977444
2026-03-24 16:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52252f1a-9213-5cb2-bcc8-b0a93fb4f145 with scrape type 2
2026-03-24 16:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52252f1a-9213-5cb2-bcc8-b0a93fb4f145 with scrape type 2
2026-03-24 16:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 52252f1a-9213-5cb2-bcc8-b0a93fb4f145, identifier: 1977444
2026-03-24 16:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 52252f1a-9213-5cb2-bcc8-b0a93fb4f145 with identifier: 1977444
2026-03-24 16:53:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 52252f1a-9213-5cb2-bcc8-b0a93fb4f145 with identifier: 1977444
2026-03-24 16:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 52252f1a-9213-5cb2-bcc8-b0a93fb4f145 with identifier: 1977444 to the API
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'BLEU DENIM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '52252f1a-9213-5cb2-bcc8-b0a93fb4f145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'GLB',
'odometer': 174664,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-23',
'seats_number': 7,
'seller_name': None,
'title': 'MERCEDES-BENZ GLB GLB 200d 150ch Business Line 8G DCT',
'transmission': 'automatic',
'trim': 'GLB 200d 150ch Business Line 8G DCT',
'vin': None,
'year': 2023}
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977444%27 HTTP/1.1" 200 None
2026-03-24 16:53:46 [ayvens.fr] INFO: Saving data for 1977444: {'auction_closing_time': 1774454400.0, 'created_time': 1774284388.345261, 'last_price_update_time': 1774371226.443645}
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977444') HTTP/1.1" 204 0
2026-03-24 16:53:46 [ayvens.fr] INFO: Found listing with ID: 1977445
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977445%27 HTTP/1.1" 200 None
2026-03-24 16:53:46 [ayvens.fr] INFO: Scrape type for 1977445: 2
2026-03-24 16:53:46 [ayvens.fr] INFO: Extracting data for car ID: 1977445
2026-03-24 16:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ba9db24-1503-5a83-979b-7cee2bb3ceeb with identifier: 1977445
2026-03-24 16:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ba9db24-1503-5a83-979b-7cee2bb3ceeb with scrape type 2
2026-03-24 16:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ba9db24-1503-5a83-979b-7cee2bb3ceeb with scrape type 2
2026-03-24 16:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1ba9db24-1503-5a83-979b-7cee2bb3ceeb, identifier: 1977445
2026-03-24 16:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1ba9db24-1503-5a83-979b-7cee2bb3ceeb with identifier: 1977445
2026-03-24 16:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1ba9db24-1503-5a83-979b-7cee2bb3ceeb with identifier: 1977445
2026-03-24 16:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1ba9db24-1503-5a83-979b-7cee2bb3ceeb with identifier: 1977445 to the API
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1ba9db24-1503-5a83-979b-7cee2bb3ceeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 167801,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977445%27 HTTP/1.1" 200 None
2026-03-24 16:53:46 [ayvens.fr] INFO: Saving data for 1977445: {'auction_closing_time': 1774454400.0, 'created_time': 1774284389.55862, 'last_price_update_time': 1774371226.811308}
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977445') HTTP/1.1" 204 0
2026-03-24 16:53:46 [ayvens.fr] INFO: Found listing with ID: 1977446
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977446%27 HTTP/1.1" 200 None
2026-03-24 16:53:46 [ayvens.fr] INFO: Scrape type for 1977446: 2
2026-03-24 16:53:46 [ayvens.fr] INFO: Extracting data for car ID: 1977446
2026-03-24 16:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162a9216-69a8-51e4-997e-5169068b1353 with identifier: 1977446
2026-03-24 16:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162a9216-69a8-51e4-997e-5169068b1353 with scrape type 2
2026-03-24 16:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162a9216-69a8-51e4-997e-5169068b1353 with scrape type 2
2026-03-24 16:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 162a9216-69a8-51e4-997e-5169068b1353, identifier: 1977446
2026-03-24 16:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 162a9216-69a8-51e4-997e-5169068b1353 with identifier: 1977446
2026-03-24 16:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 162a9216-69a8-51e4-997e-5169068b1353 with identifier: 1977446
2026-03-24 16:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 162a9216-69a8-51e4-997e-5169068b1353 with identifier: 1977446 to the API
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '162a9216-69a8-51e4-997e-5169068b1353',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 156834,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Serie 3 Touring 320dA MH 190ch Business Design',
'transmission': 'automatic',
'trim': 'Serie 3 Touring 320dA MH 190ch Business Design',
'vin': None,
'year': 2022}
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977446%27 HTTP/1.1" 200 None
2026-03-24 16:53:47 [ayvens.fr] INFO: Saving data for 1977446: {'auction_closing_time': 1774454400.0, 'created_time': 1774284390.983807, 'last_price_update_time': 1774371227.183651}
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977446') HTTP/1.1" 204 0
2026-03-24 16:53:47 [ayvens.fr] INFO: Found listing with ID: 1977447
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977447%27 HTTP/1.1" 200 None
2026-03-24 16:53:47 [ayvens.fr] INFO: Scrape type for 1977447: 2
2026-03-24 16:53:47 [ayvens.fr] INFO: Extracting data for car ID: 1977447
2026-03-24 16:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc with identifier: 1977447
2026-03-24 16:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc with scrape type 2
2026-03-24 16:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc with scrape type 2
2026-03-24 16:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc, identifier: 1977447
2026-03-24 16:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc with identifier: 1977447
2026-03-24 16:53:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc with identifier: 1977447
2026-03-24 16:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc with identifier: 1977447 to the API
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS GRAPHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '53bd2ab9-c2e7-5b55-8fe0-750fda88ddcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'OCTAVIA COMBI',
'odometer': 169335,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA OCTAVIA COMBI Octavia Combi 1.5 TSI ACT MHEV 150ch Business '
'DSG7',
'transmission': 'automatic',
'trim': 'Octavia Combi 1.5 TSI ACT MHEV 150ch Business DSG7',
'vin': None,
'year': 2023}
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977447%27 HTTP/1.1" 200 None
2026-03-24 16:53:47 [ayvens.fr] INFO: Saving data for 1977447: {'auction_closing_time': 1774454400.0, 'created_time': 1774284392.914942, 'last_price_update_time': 1774371227.562643}
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977447') HTTP/1.1" 204 0
2026-03-24 16:53:47 [ayvens.fr] INFO: Found listing with ID: 1977448
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977448%27 HTTP/1.1" 200 None
2026-03-24 16:53:47 [ayvens.fr] INFO: Scrape type for 1977448: 2
2026-03-24 16:53:47 [ayvens.fr] INFO: Extracting data for car ID: 1977448
2026-03-24 16:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51dc898f-dafc-5726-a6fc-62a87e3493f5 with identifier: 1977448
2026-03-24 16:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51dc898f-dafc-5726-a6fc-62a87e3493f5 with scrape type 2
2026-03-24 16:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51dc898f-dafc-5726-a6fc-62a87e3493f5 with scrape type 2
2026-03-24 16:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 51dc898f-dafc-5726-a6fc-62a87e3493f5, identifier: 1977448
2026-03-24 16:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 51dc898f-dafc-5726-a6fc-62a87e3493f5 with identifier: 1977448
2026-03-24 16:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 51dc898f-dafc-5726-a6fc-62a87e3493f5 with identifier: 1977448
2026-03-24 16:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 51dc898f-dafc-5726-a6fc-62a87e3493f5 with identifier: 1977448 to the API
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': '51dc898f-dafc-5726-a6fc-62a87e3493f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 153607,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 HYBRID 225ch Allure e-EAT8',
'transmission': 'automatic',
'trim': '3008 HYBRID 225ch Allure e-EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977448%27 HTTP/1.1" 200 None
2026-03-24 16:53:48 [ayvens.fr] INFO: Saving data for 1977448: {'auction_closing_time': 1774454400.0, 'created_time': 1774284394.229886, 'last_price_update_time': 1774371228.230324}
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977448') HTTP/1.1" 204 0
2026-03-24 16:53:48 [ayvens.fr] INFO: Found listing with ID: 1977449
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977449%27 HTTP/1.1" 200 None
2026-03-24 16:53:48 [ayvens.fr] INFO: Scrape type for 1977449: 2
2026-03-24 16:53:48 [ayvens.fr] INFO: Extracting data for car ID: 1977449
2026-03-24 16:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab3afa6e-e952-588c-bbca-2fcd38b090f2 with identifier: 1977449
2026-03-24 16:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab3afa6e-e952-588c-bbca-2fcd38b090f2 with scrape type 2
2026-03-24 16:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab3afa6e-e952-588c-bbca-2fcd38b090f2 with scrape type 2
2026-03-24 16:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ab3afa6e-e952-588c-bbca-2fcd38b090f2, identifier: 1977449
2026-03-24 16:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ab3afa6e-e952-588c-bbca-2fcd38b090f2 with identifier: 1977449
2026-03-24 16:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ab3afa6e-e952-588c-bbca-2fcd38b090f2 with identifier: 1977449
2026-03-24 16:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ab3afa6e-e952-588c-bbca-2fcd38b090f2 with identifier: 1977449 to the API
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'ab3afa6e-e952-588c-bbca-2fcd38b090f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 163681,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 1.5 TSI 150ch Life Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 1.5 TSI 150ch Life Business DSG7',
'vin': None,
'year': 2022}
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977449%27 HTTP/1.1" 200 None
2026-03-24 16:53:48 [ayvens.fr] INFO: Saving data for 1977449: {'auction_closing_time': 1774454400.0, 'created_time': 1774284395.336868, 'last_price_update_time': 1774371228.687037}
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977449') HTTP/1.1" 204 0
2026-03-24 16:53:48 [ayvens.fr] INFO: Found listing with ID: 1977450
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977450%27 HTTP/1.1" 200 None
2026-03-24 16:53:48 [ayvens.fr] INFO: Scrape type for 1977450: 2
2026-03-24 16:53:48 [ayvens.fr] INFO: Extracting data for car ID: 1977450
2026-03-24 16:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ffd59e-e6a8-55d1-993d-6859f9fd2234 with identifier: 1977450
2026-03-24 16:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ffd59e-e6a8-55d1-993d-6859f9fd2234 with scrape type 2
2026-03-24 16:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ffd59e-e6a8-55d1-993d-6859f9fd2234 with scrape type 2
2026-03-24 16:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 97ffd59e-e6a8-55d1-993d-6859f9fd2234, identifier: 1977450
2026-03-24 16:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 97ffd59e-e6a8-55d1-993d-6859f9fd2234 with identifier: 1977450
2026-03-24 16:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 97ffd59e-e6a8-55d1-993d-6859f9fd2234 with identifier: 1977450
2026-03-24 16:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 97ffd59e-e6a8-55d1-993d-6859f9fd2234 with identifier: 1977450 to the API
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 28,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': '97ffd59e-e6a8-55d1-993d-6859f9fd2234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 176502,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.6 E-Tech Plug-in 160ch Techno',
'transmission': 'automatic',
'trim': 'Megane Estate 1.6 E-Tech Plug-in 160ch Techno',
'vin': None,
'year': 2022}
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977450%27 HTTP/1.1" 200 None
2026-03-24 16:53:49 [ayvens.fr] INFO: Saving data for 1977450: {'auction_closing_time': 1774454400.0, 'created_time': 1774284396.907918, 'last_price_update_time': 1774371229.086638}
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977450') HTTP/1.1" 204 0
2026-03-24 16:53:49 [ayvens.fr] INFO: Found listing with ID: 1977451
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977451%27 HTTP/1.1" 200 None
2026-03-24 16:53:49 [ayvens.fr] INFO: Scrape type for 1977451: 2
2026-03-24 16:53:49 [ayvens.fr] INFO: Extracting data for car ID: 1977451
2026-03-24 16:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0256258-7798-5d76-aaee-6f763ce2dcee with identifier: 1977451
2026-03-24 16:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0256258-7798-5d76-aaee-6f763ce2dcee with scrape type 2
2026-03-24 16:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0256258-7798-5d76-aaee-6f763ce2dcee with scrape type 2
2026-03-24 16:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c0256258-7798-5d76-aaee-6f763ce2dcee, identifier: 1977451
2026-03-24 16:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c0256258-7798-5d76-aaee-6f763ce2dcee with identifier: 1977451
2026-03-24 16:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c0256258-7798-5d76-aaee-6f763ce2dcee with identifier: 1977451
2026-03-24 16:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c0256258-7798-5d76-aaee-6f763ce2dcee with identifier: 1977451 to the API
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c0256258-7798-5d76-aaee-6f763ce2dcee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 175806,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN Touran 2.0 TDI 150ch FAP Lounge Business DSG7 5 '
'places',
'transmission': 'automatic',
'trim': 'Touran 2.0 TDI 150ch FAP Lounge Business DSG7 5 places',
'vin': None,
'year': 2020}
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977451%27 HTTP/1.1" 200 None
2026-03-24 16:53:49 [ayvens.fr] INFO: Saving data for 1977451: {'auction_closing_time': 1774454400.0, 'created_time': 1774284398.418797, 'last_price_update_time': 1774371229.456054}
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977451') HTTP/1.1" 204 0
2026-03-24 16:53:49 [ayvens.fr] INFO: Found listing with ID: 1977452
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977452%27 HTTP/1.1" 200 None
2026-03-24 16:53:49 [ayvens.fr] INFO: Scrape type for 1977452: 2
2026-03-24 16:53:49 [ayvens.fr] INFO: Extracting data for car ID: 1977452
2026-03-24 16:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3698d17c-a170-58d9-9499-9cdaf92f3781 with identifier: 1977452
2026-03-24 16:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3698d17c-a170-58d9-9499-9cdaf92f3781 with scrape type 2
2026-03-24 16:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3698d17c-a170-58d9-9499-9cdaf92f3781 with scrape type 2
2026-03-24 16:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3698d17c-a170-58d9-9499-9cdaf92f3781, identifier: 1977452
2026-03-24 16:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3698d17c-a170-58d9-9499-9cdaf92f3781 with identifier: 1977452
2026-03-24 16:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3698d17c-a170-58d9-9499-9cdaf92f3781 with identifier: 1977452
2026-03-24 16:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3698d17c-a170-58d9-9499-9cdaf92f3781 with identifier: 1977452 to the API
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3698d17c-a170-58d9-9499-9cdaf92f3781',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 229643,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai 1.3 Mild Hybrid 158ch N-Style Xtronic',
'transmission': 'automatic',
'trim': 'Qashqai 1.3 Mild Hybrid 158ch N-Style Xtronic',
'vin': None,
'year': 2022}
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977452%27 HTTP/1.1" 200 None
2026-03-24 16:53:49 [ayvens.fr] INFO: Saving data for 1977452: {'auction_closing_time': 1774454400.0, 'created_time': 1774284400.153887, 'last_price_update_time': 1774371229.841237}
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977452') HTTP/1.1" 204 0
2026-03-24 16:53:49 [ayvens.fr] INFO: Found listing with ID: 1977453
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977453%27 HTTP/1.1" 200 None
2026-03-24 16:53:49 [ayvens.fr] INFO: Scrape type for 1977453: 2
2026-03-24 16:53:49 [ayvens.fr] INFO: Extracting data for car ID: 1977453
2026-03-24 16:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b845eaf0-84dd-5422-8a94-74f86f69db84 with identifier: 1977453
2026-03-24 16:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b845eaf0-84dd-5422-8a94-74f86f69db84 with scrape type 2
2026-03-24 16:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b845eaf0-84dd-5422-8a94-74f86f69db84 with scrape type 2
2026-03-24 16:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b845eaf0-84dd-5422-8a94-74f86f69db84, identifier: 1977453
2026-03-24 16:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b845eaf0-84dd-5422-8a94-74f86f69db84 with identifier: 1977453
2026-03-24 16:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b845eaf0-84dd-5422-8a94-74f86f69db84 with identifier: 1977453
2026-03-24 16:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b845eaf0-84dd-5422-8a94-74f86f69db84 with identifier: 1977453 to the API
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b845eaf0-84dd-5422-8a94-74f86f69db84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 SPACETOURER',
'odometer': 217648,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 SPACETOURER C4 SpaceTourer BlueHDi 130ch S&S Business '
'EAT8',
'transmission': 'automatic',
'trim': 'C4 SpaceTourer BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977453%27 HTTP/1.1" 200 None
2026-03-24 16:53:50 [ayvens.fr] INFO: Saving data for 1977453: {'auction_closing_time': 1774454400.0, 'created_time': 1774284401.981477, 'last_price_update_time': 1774371230.409782}
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977453') HTTP/1.1" 204 0
2026-03-24 16:53:50 [ayvens.fr] INFO: Found listing with ID: 1977454
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977454%27 HTTP/1.1" 200 None
2026-03-24 16:53:50 [ayvens.fr] INFO: Scrape type for 1977454: 2
2026-03-24 16:53:50 [ayvens.fr] INFO: Extracting data for car ID: 1977454
2026-03-24 16:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ac2696-658f-5572-b15b-965051b0b1ee with identifier: 1977454
2026-03-24 16:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ac2696-658f-5572-b15b-965051b0b1ee with scrape type 2
2026-03-24 16:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2ac2696-658f-5572-b15b-965051b0b1ee with scrape type 2
2026-03-24 16:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a2ac2696-658f-5572-b15b-965051b0b1ee, identifier: 1977454
2026-03-24 16:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a2ac2696-658f-5572-b15b-965051b0b1ee with identifier: 1977454
2026-03-24 16:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a2ac2696-658f-5572-b15b-965051b0b1ee with identifier: 1977454
2026-03-24 16:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a2ac2696-658f-5572-b15b-965051b0b1ee with identifier: 1977454 to the API
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'a2ac2696-658f-5572-b15b-965051b0b1ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 206688,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 122h Dynamic Business + Stage Hybrid Academy',
'transmission': 'automatic',
'trim': 'Corolla 122h Dynamic Business + Stage Hybrid Academy',
'vin': None,
'year': 2022}
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977454%27 HTTP/1.1" 200 None
2026-03-24 16:53:50 [ayvens.fr] INFO: Saving data for 1977454: {'auction_closing_time': 1774454400.0, 'created_time': 1774284403.411788, 'last_price_update_time': 1774371230.887109}
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977454') HTTP/1.1" 204 0
2026-03-24 16:53:50 [ayvens.fr] INFO: Found listing with ID: 1977455
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977455%27 HTTP/1.1" 200 None
2026-03-24 16:53:50 [ayvens.fr] INFO: Scrape type for 1977455: 2
2026-03-24 16:53:50 [ayvens.fr] INFO: Extracting data for car ID: 1977455
2026-03-24 16:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7aa992e-6ff6-505b-90a1-66c189cbf848 with identifier: 1977455
2026-03-24 16:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7aa992e-6ff6-505b-90a1-66c189cbf848 with scrape type 2
2026-03-24 16:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7aa992e-6ff6-505b-90a1-66c189cbf848 with scrape type 2
2026-03-24 16:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f7aa992e-6ff6-505b-90a1-66c189cbf848, identifier: 1977455
2026-03-24 16:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f7aa992e-6ff6-505b-90a1-66c189cbf848 with identifier: 1977455
2026-03-24 16:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f7aa992e-6ff6-505b-90a1-66c189cbf848 with identifier: 1977455
2026-03-24 16:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f7aa992e-6ff6-505b-90a1-66c189cbf848 with identifier: 1977455 to the API
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'f7aa992e-6ff6-505b-90a1-66c189cbf848',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 153107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977455%27 HTTP/1.1" 200 None
2026-03-24 16:53:51 [ayvens.fr] INFO: Saving data for 1977455: {'auction_closing_time': 1774454400.0, 'created_time': 1774284404.344672, 'last_price_update_time': 1774371231.444856}
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977455') HTTP/1.1" 204 0
2026-03-24 16:53:51 [ayvens.fr] INFO: Found listing with ID: 1977456
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977456%27 HTTP/1.1" 200 None
2026-03-24 16:53:51 [ayvens.fr] INFO: Scrape type for 1977456: 2
2026-03-24 16:53:51 [ayvens.fr] INFO: Extracting data for car ID: 1977456
2026-03-24 16:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c374bd0c-0e91-5b2d-983d-978eaef65e7b with identifier: 1977456
2026-03-24 16:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c374bd0c-0e91-5b2d-983d-978eaef65e7b with scrape type 2
2026-03-24 16:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c374bd0c-0e91-5b2d-983d-978eaef65e7b with scrape type 2
2026-03-24 16:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c374bd0c-0e91-5b2d-983d-978eaef65e7b, identifier: 1977456
2026-03-24 16:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c374bd0c-0e91-5b2d-983d-978eaef65e7b with identifier: 1977456
2026-03-24 16:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c374bd0c-0e91-5b2d-983d-978eaef65e7b with identifier: 1977456
2026-03-24 16:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c374bd0c-0e91-5b2d-983d-978eaef65e7b with identifier: 1977456 to the API
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 244,
'color': 'BLANC BANQUISE OPAQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c374bd0c-0e91-5b2d-983d-978eaef65e7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPER',
'odometer': 151335,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-06',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPER Jumper Fg 35 L2H2 2.2 BlueHDi 140 S&S Driver',
'transmission': 'manual',
'trim': 'Jumper Fg 35 L2H2 2.2 BlueHDi 140 S&S Driver',
'vin': None,
'year': 2020}
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977456%27 HTTP/1.1" 200 None
2026-03-24 16:53:51 [ayvens.fr] INFO: Saving data for 1977456: {'auction_closing_time': 1774454400.0, 'created_time': 1774284405.921897, 'last_price_update_time': 1774371231.846211}
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977456') HTTP/1.1" 204 0
2026-03-24 16:53:51 [ayvens.fr] INFO: Found listing with ID: 1977457
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977457%27 HTTP/1.1" 200 None
2026-03-24 16:53:51 [ayvens.fr] INFO: Scrape type for 1977457: 2
2026-03-24 16:53:51 [ayvens.fr] INFO: Extracting data for car ID: 1977457
2026-03-24 16:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb419df2-0403-5c49-8154-70e443ca8c39 with identifier: 1977457
2026-03-24 16:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb419df2-0403-5c49-8154-70e443ca8c39 with scrape type 2
2026-03-24 16:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb419df2-0403-5c49-8154-70e443ca8c39 with scrape type 2
2026-03-24 16:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: eb419df2-0403-5c49-8154-70e443ca8c39, identifier: 1977457
2026-03-24 16:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: eb419df2-0403-5c49-8154-70e443ca8c39 with identifier: 1977457
2026-03-24 16:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: eb419df2-0403-5c49-8154-70e443ca8c39 with identifier: 1977457
2026-03-24 16:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: eb419df2-0403-5c49-8154-70e443ca8c39 with identifier: 1977457 to the API
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'BLANC BANQUISE OPAQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'eb419df2-0403-5c49-8154-70e443ca8c39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPER',
'odometer': 147105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-07',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPER Jumper Fg 30 L1H1 2.0 BlueHDi 110 Club',
'transmission': 'manual',
'trim': 'Jumper Fg 30 L1H1 2.0 BlueHDi 110 Club',
'vin': None,
'year': 2019}
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977457%27 HTTP/1.1" 200 None
2026-03-24 16:53:52 [ayvens.fr] INFO: Saving data for 1977457: {'auction_closing_time': 1774454400.0, 'created_time': 1774284406.897323, 'last_price_update_time': 1774371232.361503}
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977457') HTTP/1.1" 204 0
2026-03-24 16:53:52 [ayvens.fr] INFO: Found listing with ID: 1977458
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977458%27 HTTP/1.1" 200 None
2026-03-24 16:53:52 [ayvens.fr] INFO: Scrape type for 1977458: 2
2026-03-24 16:53:52 [ayvens.fr] INFO: Extracting data for car ID: 1977458
2026-03-24 16:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4822d1a-e0b7-5692-8084-b0e1ea120d77 with identifier: 1977458
2026-03-24 16:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4822d1a-e0b7-5692-8084-b0e1ea120d77 with scrape type 2
2026-03-24 16:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4822d1a-e0b7-5692-8084-b0e1ea120d77 with scrape type 2
2026-03-24 16:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a4822d1a-e0b7-5692-8084-b0e1ea120d77, identifier: 1977458
2026-03-24 16:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a4822d1a-e0b7-5692-8084-b0e1ea120d77 with identifier: 1977458
2026-03-24 16:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a4822d1a-e0b7-5692-8084-b0e1ea120d77 with identifier: 1977458
2026-03-24 16:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a4822d1a-e0b7-5692-8084-b0e1ea120d77 with identifier: 1977458 to the API
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'a4822d1a-e0b7-5692-8084-b0e1ea120d77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 151161,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-09',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977458%27 HTTP/1.1" 200 None
2026-03-24 16:53:52 [ayvens.fr] INFO: Saving data for 1977458: {'auction_closing_time': 1774454400.0, 'created_time': 1774284408.938024, 'last_price_update_time': 1774371232.818319}
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977458') HTTP/1.1" 204 0
2026-03-24 16:53:52 [ayvens.fr] INFO: Found listing with ID: 1977459
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977459%27 HTTP/1.1" 200 None
2026-03-24 16:53:52 [ayvens.fr] INFO: Scrape type for 1977459: 2
2026-03-24 16:53:52 [ayvens.fr] INFO: Extracting data for car ID: 1977459
2026-03-24 16:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c526c70-b36a-5133-b8bb-277b70a7bcbf with identifier: 1977459
2026-03-24 16:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c526c70-b36a-5133-b8bb-277b70a7bcbf with scrape type 2
2026-03-24 16:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c526c70-b36a-5133-b8bb-277b70a7bcbf with scrape type 2
2026-03-24 16:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7c526c70-b36a-5133-b8bb-277b70a7bcbf, identifier: 1977459
2026-03-24 16:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7c526c70-b36a-5133-b8bb-277b70a7bcbf with identifier: 1977459
2026-03-24 16:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7c526c70-b36a-5133-b8bb-277b70a7bcbf with identifier: 1977459
2026-03-24 16:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7c526c70-b36a-5133-b8bb-277b70a7bcbf with identifier: 1977459 to the API
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '7c526c70-b36a-5133-b8bb-277b70a7bcbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 145817,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-15',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.6 BlueHDi 95ch Business',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.6 BlueHDi 95ch Business',
'vin': None,
'year': 2019}
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977459%27 HTTP/1.1" 200 None
2026-03-24 16:53:53 [ayvens.fr] INFO: Saving data for 1977459: {'auction_closing_time': 1774454400.0, 'created_time': 1774284410.428047, 'last_price_update_time': 1774371233.429749}
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977459') HTTP/1.1" 204 0
2026-03-24 16:53:53 [ayvens.fr] INFO: Found listing with ID: 1977460
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977460%27 HTTP/1.1" 200 None
2026-03-24 16:53:53 [ayvens.fr] INFO: Scrape type for 1977460: 2
2026-03-24 16:53:53 [ayvens.fr] INFO: Extracting data for car ID: 1977460
2026-03-24 16:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350416e5-08e0-517c-8c97-4f02a4cffb0d with identifier: 1977460
2026-03-24 16:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350416e5-08e0-517c-8c97-4f02a4cffb0d with scrape type 2
2026-03-24 16:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350416e5-08e0-517c-8c97-4f02a4cffb0d with scrape type 2
2026-03-24 16:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 350416e5-08e0-517c-8c97-4f02a4cffb0d, identifier: 1977460
2026-03-24 16:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 350416e5-08e0-517c-8c97-4f02a4cffb0d with identifier: 1977460
2026-03-24 16:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 350416e5-08e0-517c-8c97-4f02a4cffb0d with identifier: 1977460
2026-03-24 16:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 350416e5-08e0-517c-8c97-4f02a4cffb0d with identifier: 1977460 to the API
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '350416e5-08e0-517c-8c97-4f02a4cffb0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4',
'odometer': 184610,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-03',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 C4 BlueHDi 130ch S&S Feel Pack EAT8 120g',
'transmission': 'automatic',
'trim': 'C4 BlueHDi 130ch S&S Feel Pack EAT8 120g',
'vin': None,
'year': 2022}
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977460%27 HTTP/1.1" 200 None
2026-03-24 16:53:53 [ayvens.fr] INFO: Saving data for 1977460: {'auction_closing_time': 1774454400.0, 'created_time': 1774284411.624602, 'last_price_update_time': 1774371233.778927}
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977460') HTTP/1.1" 204 0
2026-03-24 16:53:53 [ayvens.fr] INFO: Found listing with ID: 1977461
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977461%27 HTTP/1.1" 200 None
2026-03-24 16:53:53 [ayvens.fr] INFO: Scrape type for 1977461: 2
2026-03-24 16:53:53 [ayvens.fr] INFO: Extracting data for car ID: 1977461
2026-03-24 16:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1be12e09-96aa-5d7c-8759-823afbd1798a with identifier: 1977461
2026-03-24 16:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be12e09-96aa-5d7c-8759-823afbd1798a with scrape type 2
2026-03-24 16:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1be12e09-96aa-5d7c-8759-823afbd1798a with scrape type 2
2026-03-24 16:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1be12e09-96aa-5d7c-8759-823afbd1798a, identifier: 1977461
2026-03-24 16:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1be12e09-96aa-5d7c-8759-823afbd1798a with identifier: 1977461
2026-03-24 16:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1be12e09-96aa-5d7c-8759-823afbd1798a with identifier: 1977461
2026-03-24 16:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1be12e09-96aa-5d7c-8759-823afbd1798a with identifier: 1977461 to the API
2026-03-24 16:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'NOIR ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '1be12e09-96aa-5d7c-8759-823afbd1798a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 141040,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KADJAR Kadjar 1.3 TCe 140ch FAP Techno EDC',
'transmission': 'automatic',
'trim': 'Kadjar 1.3 TCe 140ch FAP Techno EDC',
'vin': None,
'year': 2022}
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977461%27 HTTP/1.1" 200 None
2026-03-24 16:53:54 [ayvens.fr] INFO: Saving data for 1977461: {'auction_closing_time': 1774454400.0, 'created_time': 1774284413.149191, 'last_price_update_time': 1774371234.324847}
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977461') HTTP/1.1" 204 0
2026-03-24 16:53:54 [ayvens.fr] INFO: Found listing with ID: 1977462
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977462%27 HTTP/1.1" 200 None
2026-03-24 16:53:54 [ayvens.fr] INFO: Scrape type for 1977462: 2
2026-03-24 16:53:54 [ayvens.fr] INFO: Extracting data for car ID: 1977462
2026-03-24 16:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1 with identifier: 1977462
2026-03-24 16:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1 with scrape type 2
2026-03-24 16:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1 with scrape type 2
2026-03-24 16:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1, identifier: 1977462
2026-03-24 16:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1 with identifier: 1977462
2026-03-24 16:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1 with identifier: 1977462
2026-03-24 16:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1 with identifier: 1977462 to the API
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '41ddaa8f-5178-5d5e-9a3d-0bd4f5d1adb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'Q3 SPORTBACK',
'odometer': 142989,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI Q3 SPORTBACK Q3 Sportback 35 TDI 150ch S line S tronic 7',
'transmission': 'automatic',
'trim': 'Q3 Sportback 35 TDI 150ch S line S tronic 7',
'vin': None,
'year': 2022}
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977462%27 HTTP/1.1" 200 None
2026-03-24 16:53:54 [ayvens.fr] INFO: Saving data for 1977462: {'auction_closing_time': 1774454400.0, 'created_time': 1774284414.542576, 'last_price_update_time': 1774371234.714492}
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977462') HTTP/1.1" 204 0
2026-03-24 16:53:54 [ayvens.fr] INFO: Found listing with ID: 1977463
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977463%27 HTTP/1.1" 200 None
2026-03-24 16:53:54 [ayvens.fr] INFO: Scrape type for 1977463: 2
2026-03-24 16:53:54 [ayvens.fr] INFO: Extracting data for car ID: 1977463
2026-03-24 16:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a08cd057-e0ac-5e19-99fd-13cbe027d40a with identifier: 1977463
2026-03-24 16:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08cd057-e0ac-5e19-99fd-13cbe027d40a with scrape type 2
2026-03-24 16:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a08cd057-e0ac-5e19-99fd-13cbe027d40a with scrape type 2
2026-03-24 16:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a08cd057-e0ac-5e19-99fd-13cbe027d40a, identifier: 1977463
2026-03-24 16:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a08cd057-e0ac-5e19-99fd-13cbe027d40a with identifier: 1977463
2026-03-24 16:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a08cd057-e0ac-5e19-99fd-13cbe027d40a with identifier: 1977463
2026-03-24 16:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a08cd057-e0ac-5e19-99fd-13cbe027d40a with identifier: 1977463 to the API
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a08cd057-e0ac-5e19-99fd-13cbe027d40a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 166881,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-10',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 100ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 100ch S&S Club',
'vin': None,
'year': 2020}
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977463%27 HTTP/1.1" 200 None
2026-03-24 16:53:55 [ayvens.fr] INFO: Saving data for 1977463: {'auction_closing_time': 1774454400.0, 'created_time': 1774284416.119038, 'last_price_update_time': 1774371235.088777}
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977463') HTTP/1.1" 204 0
2026-03-24 16:53:55 [ayvens.fr] INFO: Found listing with ID: 1977464
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977464%27 HTTP/1.1" 200 None
2026-03-24 16:53:55 [ayvens.fr] INFO: Scrape type for 1977464: 2
2026-03-24 16:53:55 [ayvens.fr] INFO: Extracting data for car ID: 1977464
2026-03-24 16:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba714fc-c285-558e-9c2a-8d34b55fdeb4 with identifier: 1977464
2026-03-24 16:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba714fc-c285-558e-9c2a-8d34b55fdeb4 with scrape type 2
2026-03-24 16:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba714fc-c285-558e-9c2a-8d34b55fdeb4 with scrape type 2
2026-03-24 16:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4ba714fc-c285-558e-9c2a-8d34b55fdeb4, identifier: 1977464
2026-03-24 16:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4ba714fc-c285-558e-9c2a-8d34b55fdeb4 with identifier: 1977464
2026-03-24 16:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4ba714fc-c285-558e-9c2a-8d34b55fdeb4 with identifier: 1977464
2026-03-24 16:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4ba714fc-c285-558e-9c2a-8d34b55fdeb4 with identifier: 1977464 to the API
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'NOIR METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '4ba714fc-c285-558e-9c2a-8d34b55fdeb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 141821,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Design BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Design BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977464%27 HTTP/1.1" 200 None
2026-03-24 16:53:55 [ayvens.fr] INFO: Saving data for 1977464: {'auction_closing_time': 1774454400.0, 'created_time': 1774284417.247529, 'last_price_update_time': 1774371235.495063}
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977464') HTTP/1.1" 204 0
2026-03-24 16:53:55 [ayvens.fr] INFO: Found listing with ID: 1977465
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977465%27 HTTP/1.1" 200 None
2026-03-24 16:53:55 [ayvens.fr] INFO: Scrape type for 1977465: 2
2026-03-24 16:53:55 [ayvens.fr] INFO: Extracting data for car ID: 1977465
2026-03-24 16:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00098da8-db37-59f2-8109-9620dd81c2f1 with identifier: 1977465
2026-03-24 16:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00098da8-db37-59f2-8109-9620dd81c2f1 with scrape type 2
2026-03-24 16:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00098da8-db37-59f2-8109-9620dd81c2f1 with scrape type 2
2026-03-24 16:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 00098da8-db37-59f2-8109-9620dd81c2f1, identifier: 1977465
2026-03-24 16:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 00098da8-db37-59f2-8109-9620dd81c2f1 with identifier: 1977465
2026-03-24 16:53:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 00098da8-db37-59f2-8109-9620dd81c2f1 with identifier: 1977465
2026-03-24 16:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 00098da8-db37-59f2-8109-9620dd81c2f1 with identifier: 1977465 to the API
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'GRIS METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '00098da8-db37-59f2-8109-9620dd81c2f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 192728,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.3 TCe mild hybrid 140ch Evolution EDC -',
'transmission': 'automatic',
'trim': 'Arkana 1.3 TCe mild hybrid 140ch Evolution EDC -',
'vin': None,
'year': 2023}
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977465%27 HTTP/1.1" 200 None
2026-03-24 16:53:55 [ayvens.fr] INFO: Saving data for 1977465: {'auction_closing_time': 1774454400.0, 'created_time': 1774284418.298475, 'last_price_update_time': 1774371235.924985}
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977465') HTTP/1.1" 204 0
2026-03-24 16:53:55 [ayvens.fr] INFO: Found listing with ID: 1977466
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977466%27 HTTP/1.1" 200 None
2026-03-24 16:53:55 [ayvens.fr] INFO: Scrape type for 1977466: 2
2026-03-24 16:53:55 [ayvens.fr] INFO: Extracting data for car ID: 1977466
2026-03-24 16:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f951c2f4-6b46-53ce-a480-68917bf34f27 with identifier: 1977466
2026-03-24 16:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f951c2f4-6b46-53ce-a480-68917bf34f27 with scrape type 2
2026-03-24 16:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f951c2f4-6b46-53ce-a480-68917bf34f27 with scrape type 2
2026-03-24 16:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f951c2f4-6b46-53ce-a480-68917bf34f27, identifier: 1977466
2026-03-24 16:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f951c2f4-6b46-53ce-a480-68917bf34f27 with identifier: 1977466
2026-03-24 16:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f951c2f4-6b46-53ce-a480-68917bf34f27 with identifier: 1977466
2026-03-24 16:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f951c2f4-6b46-53ce-a480-68917bf34f27 with identifier: 1977466 to the API
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f951c2f4-6b46-53ce-a480-68917bf34f27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 152501,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977466%27 HTTP/1.1" 200 None
2026-03-24 16:53:56 [ayvens.fr] INFO: Saving data for 1977466: {'auction_closing_time': 1774454400.0, 'created_time': 1774284420.434771, 'last_price_update_time': 1774371236.440809}
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977466') HTTP/1.1" 204 0
2026-03-24 16:53:56 [ayvens.fr] INFO: Found listing with ID: 1977467
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977467%27 HTTP/1.1" 200 None
2026-03-24 16:53:56 [ayvens.fr] INFO: Scrape type for 1977467: 2
2026-03-24 16:53:56 [ayvens.fr] INFO: Extracting data for car ID: 1977467
2026-03-24 16:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09616185-6386-5870-b4bb-bf40bfe6fb9f with identifier: 1977467
2026-03-24 16:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09616185-6386-5870-b4bb-bf40bfe6fb9f with scrape type 2
2026-03-24 16:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09616185-6386-5870-b4bb-bf40bfe6fb9f with scrape type 2
2026-03-24 16:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 09616185-6386-5870-b4bb-bf40bfe6fb9f, identifier: 1977467
2026-03-24 16:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 09616185-6386-5870-b4bb-bf40bfe6fb9f with identifier: 1977467
2026-03-24 16:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 09616185-6386-5870-b4bb-bf40bfe6fb9f with identifier: 1977467
2026-03-24 16:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 09616185-6386-5870-b4bb-bf40bfe6fb9f with identifier: 1977467 to the API
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '09616185-6386-5870-b4bb-bf40bfe6fb9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CONNECT VU',
'odometer': 144791,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-10',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CONNECT VU Transit Connect L1 1.5 TD 100ch Stop&Start '
'Trend Business Nav',
'transmission': 'manual',
'trim': 'Transit Connect L1 1.5 TD 100ch Stop&Start Trend Business Nav',
'vin': None,
'year': 2019}
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977467%27 HTTP/1.1" 200 None
2026-03-24 16:53:56 [ayvens.fr] INFO: Saving data for 1977467: {'auction_closing_time': 1774454400.0, 'created_time': 1774284421.28262, 'last_price_update_time': 1774371236.852137}
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977467') HTTP/1.1" 204 0
2026-03-24 16:53:56 [ayvens.fr] INFO: Found listing with ID: 1977468
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977468%27 HTTP/1.1" 200 None
2026-03-24 16:53:56 [ayvens.fr] INFO: Scrape type for 1977468: 2
2026-03-24 16:53:56 [ayvens.fr] INFO: Extracting data for car ID: 1977468
2026-03-24 16:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9b572c-8b36-5a57-b81b-3e00357a9787 with identifier: 1977468
2026-03-24 16:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9b572c-8b36-5a57-b81b-3e00357a9787 with scrape type 2
2026-03-24 16:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9b572c-8b36-5a57-b81b-3e00357a9787 with scrape type 2
2026-03-24 16:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ba9b572c-8b36-5a57-b81b-3e00357a9787, identifier: 1977468
2026-03-24 16:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ba9b572c-8b36-5a57-b81b-3e00357a9787 with identifier: 1977468
2026-03-24 16:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ba9b572c-8b36-5a57-b81b-3e00357a9787 with identifier: 1977468
2026-03-24 16:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ba9b572c-8b36-5a57-b81b-3e00357a9787 with identifier: 1977468 to the API
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': 'ba9b572c-8b36-5a57-b81b-3e00357a9787',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 169133,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 CRDi 136ch MHEV Active Business DCT7 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 CRDi 136ch MHEV Active Business DCT7 4x2',
'vin': None,
'year': 2022}
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977468%27 HTTP/1.1" 200 None
2026-03-24 16:53:57 [ayvens.fr] INFO: Saving data for 1977468: {'auction_closing_time': 1774454400.0, 'created_time': 1774284422.630658, 'last_price_update_time': 1774371237.369766}
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977468') HTTP/1.1" 204 0
2026-03-24 16:53:57 [ayvens.fr] INFO: Found listing with ID: 1977469
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977469%27 HTTP/1.1" 200 None
2026-03-24 16:53:57 [ayvens.fr] INFO: Scrape type for 1977469: 2
2026-03-24 16:53:57 [ayvens.fr] INFO: Extracting data for car ID: 1977469
2026-03-24 16:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad683b6a-5598-5a6a-8c7f-b40d173752be with identifier: 1977469
2026-03-24 16:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad683b6a-5598-5a6a-8c7f-b40d173752be with scrape type 2
2026-03-24 16:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad683b6a-5598-5a6a-8c7f-b40d173752be with scrape type 2
2026-03-24 16:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ad683b6a-5598-5a6a-8c7f-b40d173752be, identifier: 1977469
2026-03-24 16:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ad683b6a-5598-5a6a-8c7f-b40d173752be with identifier: 1977469
2026-03-24 16:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ad683b6a-5598-5a6a-8c7f-b40d173752be with identifier: 1977469
2026-03-24 16:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ad683b6a-5598-5a6a-8c7f-b40d173752be with identifier: 1977469 to the API
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'ad683b6a-5598-5a6a-8c7f-b40d173752be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 141105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-11',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Nav',
'vin': None,
'year': 2022}
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977469%27 HTTP/1.1" 200 None
2026-03-24 16:53:57 [ayvens.fr] INFO: Saving data for 1977469: {'auction_closing_time': 1774454400.0, 'created_time': 1774284424.400588, 'last_price_update_time': 1774371237.799015}
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977469') HTTP/1.1" 204 0
2026-03-24 16:53:57 [ayvens.fr] INFO: Found listing with ID: 1977470
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977470%27 HTTP/1.1" 200 None
2026-03-24 16:53:57 [ayvens.fr] INFO: Scrape type for 1977470: 2
2026-03-24 16:53:57 [ayvens.fr] INFO: Extracting data for car ID: 1977470
2026-03-24 16:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b with identifier: 1977470
2026-03-24 16:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b with scrape type 2
2026-03-24 16:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b with scrape type 2
2026-03-24 16:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b, identifier: 1977470
2026-03-24 16:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b with identifier: 1977470
2026-03-24 16:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b with identifier: 1977470
2026-03-24 16:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b with identifier: 1977470 to the API
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '7ef8dea4-4011-59f3-b76f-6a8bd9a9e00b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 GC',
'odometer': 150867,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 2 GC Serie 2 Gran Coupe 216dA 116ch M Sport',
'transmission': 'automatic',
'trim': 'Serie 2 Gran Coupe 216dA 116ch M Sport',
'vin': None,
'year': 2022}
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977470%27 HTTP/1.1" 200 None
2026-03-24 16:53:58 [ayvens.fr] INFO: Saving data for 1977470: {'auction_closing_time': 1774454400.0, 'created_time': 1774284425.67491, 'last_price_update_time': 1774371238.336509}
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977470') HTTP/1.1" 204 0
2026-03-24 16:53:58 [ayvens.fr] INFO: Found listing with ID: 1977471
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977471%27 HTTP/1.1" 200 None
2026-03-24 16:53:58 [ayvens.fr] INFO: Scrape type for 1977471: 2
2026-03-24 16:53:58 [ayvens.fr] INFO: Extracting data for car ID: 1977471
2026-03-24 16:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821c9d07-00d4-5571-a774-340229d901a1 with identifier: 1977471
2026-03-24 16:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821c9d07-00d4-5571-a774-340229d901a1 with scrape type 2
2026-03-24 16:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821c9d07-00d4-5571-a774-340229d901a1 with scrape type 2
2026-03-24 16:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 821c9d07-00d4-5571-a774-340229d901a1, identifier: 1977471
2026-03-24 16:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 821c9d07-00d4-5571-a774-340229d901a1 with identifier: 1977471
2026-03-24 16:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 821c9d07-00d4-5571-a774-340229d901a1 with identifier: 1977471
2026-03-24 16:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 821c9d07-00d4-5571-a774-340229d901a1 with identifier: 1977471 to the API
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '821c9d07-00d4-5571-a774-340229d901a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 172601,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977471%27 HTTP/1.1" 200 None
2026-03-24 16:53:58 [ayvens.fr] INFO: Saving data for 1977471: {'auction_closing_time': 1774454400.0, 'created_time': 1774284427.056927, 'last_price_update_time': 1774371238.691706}
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977471') HTTP/1.1" 204 0
2026-03-24 16:53:58 [ayvens.fr] INFO: Found listing with ID: 1977472
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977472%27 HTTP/1.1" 200 None
2026-03-24 16:53:58 [ayvens.fr] INFO: Scrape type for 1977472: 2
2026-03-24 16:53:58 [ayvens.fr] INFO: Extracting data for car ID: 1977472
2026-03-24 16:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe7fbdd-2472-50ab-a53d-1d1dd9615b83 with identifier: 1977472
2026-03-24 16:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe7fbdd-2472-50ab-a53d-1d1dd9615b83 with scrape type 2
2026-03-24 16:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe7fbdd-2472-50ab-a53d-1d1dd9615b83 with scrape type 2
2026-03-24 16:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: afe7fbdd-2472-50ab-a53d-1d1dd9615b83, identifier: 1977472
2026-03-24 16:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: afe7fbdd-2472-50ab-a53d-1d1dd9615b83 with identifier: 1977472
2026-03-24 16:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: afe7fbdd-2472-50ab-a53d-1d1dd9615b83 with identifier: 1977472
2026-03-24 16:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: afe7fbdd-2472-50ab-a53d-1d1dd9615b83 with identifier: 1977472 to the API
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'afe7fbdd-2472-50ab-a53d-1d1dd9615b83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SUPERB',
'odometer': 172806,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SUPERB Superb 1.5 TSI ACT 150ch Business DSG7',
'transmission': 'automatic',
'trim': 'Superb 1.5 TSI ACT 150ch Business DSG7',
'vin': None,
'year': 2022}
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977472%27 HTTP/1.1" 200 None
2026-03-24 16:53:59 [ayvens.fr] INFO: Saving data for 1977472: {'auction_closing_time': 1774454400.0, 'created_time': 1774284428.360314, 'last_price_update_time': 1774371239.066871}
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977472') HTTP/1.1" 204 0
2026-03-24 16:53:59 [ayvens.fr] INFO: Found listing with ID: 1977473
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977473%27 HTTP/1.1" 200 None
2026-03-24 16:53:59 [ayvens.fr] INFO: Scrape type for 1977473: 2
2026-03-24 16:53:59 [ayvens.fr] INFO: Extracting data for car ID: 1977473
2026-03-24 16:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0da51b-99a8-5789-b671-ed533692c360 with identifier: 1977473
2026-03-24 16:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0da51b-99a8-5789-b671-ed533692c360 with scrape type 2
2026-03-24 16:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b0da51b-99a8-5789-b671-ed533692c360 with scrape type 2
2026-03-24 16:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5b0da51b-99a8-5789-b671-ed533692c360, identifier: 1977473
2026-03-24 16:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5b0da51b-99a8-5789-b671-ed533692c360 with identifier: 1977473
2026-03-24 16:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5b0da51b-99a8-5789-b671-ed533692c360 with identifier: 1977473
2026-03-24 16:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5b0da51b-99a8-5789-b671-ed533692c360 with identifier: 1977473 to the API
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '5b0da51b-99a8-5789-b671-ed533692c360',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 167017,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977473%27 HTTP/1.1" 200 None
2026-03-24 16:53:59 [ayvens.fr] INFO: Saving data for 1977473: {'auction_closing_time': 1774454400.0, 'created_time': 1774284430.590843, 'last_price_update_time': 1774371239.444423}
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977473') HTTP/1.1" 204 0
2026-03-24 16:53:59 [ayvens.fr] INFO: Found listing with ID: 1977474
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977474%27 HTTP/1.1" 200 None
2026-03-24 16:53:59 [ayvens.fr] INFO: Scrape type for 1977474: 2
2026-03-24 16:53:59 [ayvens.fr] INFO: Extracting data for car ID: 1977474
2026-03-24 16:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75 with identifier: 1977474
2026-03-24 16:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75 with scrape type 2
2026-03-24 16:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75 with scrape type 2
2026-03-24 16:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75, identifier: 1977474
2026-03-24 16:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75 with identifier: 1977474
2026-03-24 16:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75 with identifier: 1977474
2026-03-24 16:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75 with identifier: 1977474 to the API
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS PERLE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '49f0ba12-1bc2-5dd1-a56e-c0aabb2dbe75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 186767,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977474%27 HTTP/1.1" 200 None
2026-03-24 16:53:59 [ayvens.fr] INFO: Saving data for 1977474: {'auction_closing_time': 1774454400.0, 'created_time': 1774284431.728043, 'last_price_update_time': 1774371239.799976}
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977474') HTTP/1.1" 204 0
2026-03-24 16:53:59 [ayvens.fr] INFO: Found listing with ID: 1977475
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977475%27 HTTP/1.1" 200 None
2026-03-24 16:53:59 [ayvens.fr] INFO: Scrape type for 1977475: 2
2026-03-24 16:53:59 [ayvens.fr] INFO: Extracting data for car ID: 1977475
2026-03-24 16:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29 with identifier: 1977475
2026-03-24 16:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29 with scrape type 2
2026-03-24 16:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29 with scrape type 2
2026-03-24 16:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29, identifier: 1977475
2026-03-24 16:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29 with identifier: 1977475
2026-03-24 16:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29 with identifier: 1977475
2026-03-24 16:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29 with identifier: 1977475 to the API
2026-03-24 16:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 169,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '9f6054e2-1e0a-5a07-abdd-aa9d8cb34f29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'PROACE',
'odometer': 161926,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-10',
'seats_number': 9,
'seller_name': None,
'title': 'TOYOTA PROACE PROACE Combi Long 1.5 120 D-4D Dynamic',
'transmission': 'manual',
'trim': 'PROACE Combi Long 1.5 120 D-4D Dynamic',
'vin': None,
'year': 2020}
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977475%27 HTTP/1.1" 200 None
2026-03-24 16:54:00 [ayvens.fr] INFO: Saving data for 1977475: {'auction_closing_time': 1774454400.0, 'created_time': 1774284433.156074, 'last_price_update_time': 1774371240.231868}
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977475') HTTP/1.1" 204 0
2026-03-24 16:54:00 [ayvens.fr] INFO: Found listing with ID: 1977476
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977476%27 HTTP/1.1" 200 None
2026-03-24 16:54:00 [ayvens.fr] INFO: Scrape type for 1977476: 2
2026-03-24 16:54:00 [ayvens.fr] INFO: Extracting data for car ID: 1977476
2026-03-24 16:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45813275-e669-51a0-a24b-a43665b3eeec with identifier: 1977476
2026-03-24 16:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45813275-e669-51a0-a24b-a43665b3eeec with scrape type 2
2026-03-24 16:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45813275-e669-51a0-a24b-a43665b3eeec with scrape type 2
2026-03-24 16:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 45813275-e669-51a0-a24b-a43665b3eeec, identifier: 1977476
2026-03-24 16:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 45813275-e669-51a0-a24b-a43665b3eeec with identifier: 1977476
2026-03-24 16:54:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 45813275-e669-51a0-a24b-a43665b3eeec with identifier: 1977476
2026-03-24 16:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 45813275-e669-51a0-a24b-a43665b3eeec with identifier: 1977476 to the API
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLEU ENERGIE UNI',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '45813275-e669-51a0-a24b-a43665b3eeec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SUPERB COMBI',
'odometer': 193914,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SUPERB COMBI Superb Combi 2.0 TDI 150ch SCR Business DSG7',
'transmission': 'automatic',
'trim': 'Superb Combi 2.0 TDI 150ch SCR Business DSG7',
'vin': None,
'year': 2023}
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977476%27 HTTP/1.1" 200 None
2026-03-24 16:54:00 [ayvens.fr] INFO: Saving data for 1977476: {'auction_closing_time': 1774454400.0, 'created_time': 1774284434.878591, 'last_price_update_time': 1774371240.654084}
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977476') HTTP/1.1" 204 0
2026-03-24 16:54:00 [ayvens.fr] INFO: Found listing with ID: 1977477
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977477%27 HTTP/1.1" 200 None
2026-03-24 16:54:00 [ayvens.fr] INFO: Scrape type for 1977477: 2
2026-03-24 16:54:00 [ayvens.fr] INFO: Extracting data for car ID: 1977477
2026-03-24 16:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d with identifier: 1977477
2026-03-24 16:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d with scrape type 2
2026-03-24 16:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d with scrape type 2
2026-03-24 16:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d, identifier: 1977477
2026-03-24 16:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d with identifier: 1977477
2026-03-24 16:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d with identifier: 1977477
2026-03-24 16:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 893d5ec9-7e75-5edb-8b59-a2b7d7cb045d with identifier: 1977477 to the API
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '893d5ec9-7e75-5edb-8b59-a2b7d7cb045d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 153761,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-28',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977477%27 HTTP/1.1" 200 None
2026-03-24 16:54:01 [ayvens.fr] INFO: Saving data for 1977477: {'auction_closing_time': 1774454400.0, 'created_time': 1774284436.492162, 'last_price_update_time': 1774371241.023809}
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977477') HTTP/1.1" 204 0
2026-03-24 16:54:01 [ayvens.fr] INFO: Found listing with ID: 1977478
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977478%27 HTTP/1.1" 200 None
2026-03-24 16:54:01 [ayvens.fr] INFO: Scrape type for 1977478: 2
2026-03-24 16:54:01 [ayvens.fr] INFO: Extracting data for car ID: 1977478
2026-03-24 16:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7 with identifier: 1977478
2026-03-24 16:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7 with scrape type 2
2026-03-24 16:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7 with scrape type 2
2026-03-24 16:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7, identifier: 1977478
2026-03-24 16:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7 with identifier: 1977478
2026-03-24 16:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7 with identifier: 1977478
2026-03-24 16:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7 with identifier: 1977478 to the API
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'NOIR MYTHIC METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f299dd0b-eea0-5fc1-acbc-dc3bfc2889f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'Q3',
'odometer': 170362,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI Q3 Q3 35 TFSI 150ch Mild Hybrid Business line S tronic 7',
'transmission': 'automatic',
'trim': 'Q3 35 TFSI 150ch Mild Hybrid Business line S tronic 7',
'vin': None,
'year': 2021}
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977478%27 HTTP/1.1" 200 None
2026-03-24 16:54:01 [ayvens.fr] INFO: Saving data for 1977478: {'auction_closing_time': 1774454400.0, 'created_time': 1774284437.390239, 'last_price_update_time': 1774371241.436479}
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977478') HTTP/1.1" 204 0
2026-03-24 16:54:01 [ayvens.fr] INFO: Found listing with ID: 1977479
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977479%27 HTTP/1.1" 200 None
2026-03-24 16:54:01 [ayvens.fr] INFO: Scrape type for 1977479: 2
2026-03-24 16:54:01 [ayvens.fr] INFO: Extracting data for car ID: 1977479
2026-03-24 16:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1763fc15-1ca0-5d7f-8151-38d218ab6039 with identifier: 1977479
2026-03-24 16:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1763fc15-1ca0-5d7f-8151-38d218ab6039 with scrape type 2
2026-03-24 16:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1763fc15-1ca0-5d7f-8151-38d218ab6039 with scrape type 2
2026-03-24 16:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1763fc15-1ca0-5d7f-8151-38d218ab6039, identifier: 1977479
2026-03-24 16:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1763fc15-1ca0-5d7f-8151-38d218ab6039 with identifier: 1977479
2026-03-24 16:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1763fc15-1ca0-5d7f-8151-38d218ab6039 with identifier: 1977479
2026-03-24 16:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1763fc15-1ca0-5d7f-8151-38d218ab6039 with identifier: 1977479 to the API
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1763fc15-1ca0-5d7f-8151-38d218ab6039',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 192189,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 110ch S&S Allure Pack',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 110ch S&S Allure Pack',
'vin': None,
'year': 2022}
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977479%27 HTTP/1.1" 200 None
2026-03-24 16:54:01 [ayvens.fr] INFO: Saving data for 1977479: {'auction_closing_time': 1774454400.0, 'created_time': 1774284439.677249, 'last_price_update_time': 1774371241.878}
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977479') HTTP/1.1" 204 0
2026-03-24 16:54:01 [ayvens.fr] INFO: Found listing with ID: 1977480
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977480%27 HTTP/1.1" 200 None
2026-03-24 16:54:01 [ayvens.fr] INFO: Scrape type for 1977480: 2
2026-03-24 16:54:01 [ayvens.fr] INFO: Extracting data for car ID: 1977480
2026-03-24 16:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49a15393-31d0-5df5-9470-3043901010e6 with identifier: 1977480
2026-03-24 16:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49a15393-31d0-5df5-9470-3043901010e6 with scrape type 2
2026-03-24 16:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49a15393-31d0-5df5-9470-3043901010e6 with scrape type 2
2026-03-24 16:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 49a15393-31d0-5df5-9470-3043901010e6, identifier: 1977480
2026-03-24 16:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 49a15393-31d0-5df5-9470-3043901010e6 with identifier: 1977480
2026-03-24 16:54:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 49a15393-31d0-5df5-9470-3043901010e6 with identifier: 1977480
2026-03-24 16:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 49a15393-31d0-5df5-9470-3043901010e6 with identifier: 1977480 to the API
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'BLANC PUR UNI',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '49a15393-31d0-5df5-9470-3043901010e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'T-ROC',
'odometer': 152304,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN T-ROC T-Roc 1.5 TSI EVO 150ch Carat DSG7',
'transmission': 'automatic',
'trim': 'T-Roc 1.5 TSI EVO 150ch Carat DSG7',
'vin': None,
'year': 2019}
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977480%27 HTTP/1.1" 200 None
2026-03-24 16:54:02 [ayvens.fr] INFO: Saving data for 1977480: {'auction_closing_time': 1774454400.0, 'created_time': 1774284440.641371, 'last_price_update_time': 1774371242.378929}
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977480') HTTP/1.1" 204 0
2026-03-24 16:54:02 [ayvens.fr] INFO: Found listing with ID: 1977481
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977481%27 HTTP/1.1" 200 None
2026-03-24 16:54:02 [ayvens.fr] INFO: Scrape type for 1977481: 2
2026-03-24 16:54:02 [ayvens.fr] INFO: Extracting data for car ID: 1977481
2026-03-24 16:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60d75d4-d324-5d7e-8221-20881d9aaf8d with identifier: 1977481
2026-03-24 16:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60d75d4-d324-5d7e-8221-20881d9aaf8d with scrape type 2
2026-03-24 16:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60d75d4-d324-5d7e-8221-20881d9aaf8d with scrape type 2
2026-03-24 16:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b60d75d4-d324-5d7e-8221-20881d9aaf8d, identifier: 1977481
2026-03-24 16:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b60d75d4-d324-5d7e-8221-20881d9aaf8d with identifier: 1977481
2026-03-24 16:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b60d75d4-d324-5d7e-8221-20881d9aaf8d with identifier: 1977481
2026-03-24 16:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b60d75d4-d324-5d7e-8221-20881d9aaf8d with identifier: 1977481 to the API
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 46,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'b60d75d4-d324-5d7e-8221-20881d9aaf8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'GLC',
'odometer': 166023,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ GLC GLC 300 e 211+122ch Business Line 4Matic '
'9G-Tronic',
'transmission': 'automatic',
'trim': 'GLC 300 e 211+122ch Business Line 4Matic 9G-Tronic',
'vin': None,
'year': 2021}
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977481%27 HTTP/1.1" 200 None
2026-03-24 16:54:02 [ayvens.fr] INFO: Saving data for 1977481: {'auction_closing_time': 1774454400.0, 'created_time': 1774284442.785482, 'last_price_update_time': 1774371242.889177}
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977481') HTTP/1.1" 204 0
2026-03-24 16:54:02 [ayvens.fr] INFO: Found listing with ID: 1977482
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977482%27 HTTP/1.1" 200 None
2026-03-24 16:54:02 [ayvens.fr] INFO: Scrape type for 1977482: 2
2026-03-24 16:54:02 [ayvens.fr] INFO: Extracting data for car ID: 1977482
2026-03-24 16:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc76ebf-76c6-5332-b694-84d8fdf013aa with identifier: 1977482
2026-03-24 16:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc76ebf-76c6-5332-b694-84d8fdf013aa with scrape type 2
2026-03-24 16:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc76ebf-76c6-5332-b694-84d8fdf013aa with scrape type 2
2026-03-24 16:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0dc76ebf-76c6-5332-b694-84d8fdf013aa, identifier: 1977482
2026-03-24 16:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0dc76ebf-76c6-5332-b694-84d8fdf013aa with identifier: 1977482
2026-03-24 16:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0dc76ebf-76c6-5332-b694-84d8fdf013aa with identifier: 1977482
2026-03-24 16:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0dc76ebf-76c6-5332-b694-84d8fdf013aa with identifier: 1977482 to the API
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0dc76ebf-76c6-5332-b694-84d8fdf013aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 159689,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-01',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S GT EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977482%27 HTTP/1.1" 200 None
2026-03-24 16:54:03 [ayvens.fr] INFO: Saving data for 1977482: {'auction_closing_time': 1774454400.0, 'created_time': 1774284443.492615, 'last_price_update_time': 1774371243.337096}
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977482') HTTP/1.1" 204 0
2026-03-24 16:54:03 [ayvens.fr] INFO: Found listing with ID: 1977483
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977483%27 HTTP/1.1" 200 None
2026-03-24 16:54:03 [ayvens.fr] INFO: Scrape type for 1977483: 2
2026-03-24 16:54:03 [ayvens.fr] INFO: Extracting data for car ID: 1977483
2026-03-24 16:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0367874-e59e-53a0-a822-b630383f1b64 with identifier: 1977483
2026-03-24 16:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0367874-e59e-53a0-a822-b630383f1b64 with scrape type 2
2026-03-24 16:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0367874-e59e-53a0-a822-b630383f1b64 with scrape type 2
2026-03-24 16:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c0367874-e59e-53a0-a822-b630383f1b64, identifier: 1977483
2026-03-24 16:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c0367874-e59e-53a0-a822-b630383f1b64 with identifier: 1977483
2026-03-24 16:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c0367874-e59e-53a0-a822-b630383f1b64 with identifier: 1977483
2026-03-24 16:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c0367874-e59e-53a0-a822-b630383f1b64 with identifier: 1977483 to the API
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'c0367874-e59e-53a0-a822-b630383f1b64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 159829,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977483%27 HTTP/1.1" 200 None
2026-03-24 16:54:03 [ayvens.fr] INFO: Saving data for 1977483: {'auction_closing_time': 1774454400.0, 'created_time': 1774284445.095806, 'last_price_update_time': 1774371243.740314}
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977483') HTTP/1.1" 204 0
2026-03-24 16:54:03 [ayvens.fr] INFO: Found listing with ID: 1977484
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977484%27 HTTP/1.1" 200 None
2026-03-24 16:54:03 [ayvens.fr] INFO: Scrape type for 1977484: 2
2026-03-24 16:54:03 [ayvens.fr] INFO: Extracting data for car ID: 1977484
2026-03-24 16:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb9ea037-50e4-53c9-b1a8-94cded347395 with identifier: 1977484
2026-03-24 16:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb9ea037-50e4-53c9-b1a8-94cded347395 with scrape type 2
2026-03-24 16:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb9ea037-50e4-53c9-b1a8-94cded347395 with scrape type 2
2026-03-24 16:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cb9ea037-50e4-53c9-b1a8-94cded347395, identifier: 1977484
2026-03-24 16:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cb9ea037-50e4-53c9-b1a8-94cded347395 with identifier: 1977484
2026-03-24 16:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cb9ea037-50e4-53c9-b1a8-94cded347395 with identifier: 1977484
2026-03-24 16:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cb9ea037-50e4-53c9-b1a8-94cded347395 with identifier: 1977484 to the API
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'NOIR INTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'cb9ea037-50e4-53c9-b1a8-94cded347395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 165168,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 2.0 TDI 150ch Elegance DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 2.0 TDI 150ch Elegance DSG7',
'vin': None,
'year': 2021}
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977484%27 HTTP/1.1" 200 None
2026-03-24 16:54:04 [ayvens.fr] INFO: Saving data for 1977484: {'auction_closing_time': 1774454400.0, 'created_time': 1774284446.42348, 'last_price_update_time': 1774371244.347025}
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977484') HTTP/1.1" 204 0
2026-03-24 16:54:04 [ayvens.fr] INFO: Found listing with ID: 1977485
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977485%27 HTTP/1.1" 200 None
2026-03-24 16:54:04 [ayvens.fr] INFO: Scrape type for 1977485: 2
2026-03-24 16:54:04 [ayvens.fr] INFO: Extracting data for car ID: 1977485
2026-03-24 16:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb with identifier: 1977485
2026-03-24 16:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb with scrape type 2
2026-03-24 16:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb with scrape type 2
2026-03-24 16:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb, identifier: 1977485
2026-03-24 16:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb with identifier: 1977485
2026-03-24 16:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb with identifier: 1977485
2026-03-24 16:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb with identifier: 1977485 to the API
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-03-24 16:54:04 [crawlers.pipelines.post_to_api] ERROR: ayvens.fr, item_id 60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Color","ErrorMessage":"color value can only be expressed in letters","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 24 Mar 2026 16:54:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-03-24 16:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '60ec69eb-b4d6-5739-a37b-a6d41f9ed7eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 154143,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977485%27 HTTP/1.1" 200 None
2026-03-24 16:54:04 [ayvens.fr] INFO: Saving data for 1977485: {'auction_closing_time': 1774454400.0, 'created_time': 1774284447.615178, 'last_price_update_time': 1774371244.710926}
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977485') HTTP/1.1" 204 0
2026-03-24 16:54:04 [ayvens.fr] INFO: Found listing with ID: 1977486
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977486%27 HTTP/1.1" 200 None
2026-03-24 16:54:04 [ayvens.fr] INFO: Scrape type for 1977486: 2
2026-03-24 16:54:04 [ayvens.fr] INFO: Extracting data for car ID: 1977486
2026-03-24 16:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c5189b1-3237-5e33-a7d7-4600d38ea98b with identifier: 1977486
2026-03-24 16:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c5189b1-3237-5e33-a7d7-4600d38ea98b with scrape type 2
2026-03-24 16:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c5189b1-3237-5e33-a7d7-4600d38ea98b with scrape type 2
2026-03-24 16:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6c5189b1-3237-5e33-a7d7-4600d38ea98b, identifier: 1977486
2026-03-24 16:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6c5189b1-3237-5e33-a7d7-4600d38ea98b with identifier: 1977486
2026-03-24 16:54:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6c5189b1-3237-5e33-a7d7-4600d38ea98b with identifier: 1977486
2026-03-24 16:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6c5189b1-3237-5e33-a7d7-4600d38ea98b with identifier: 1977486 to the API
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'ORANGE FUSION',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '6c5189b1-3237-5e33-a7d7-4600d38ea98b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 182068,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977486%27 HTTP/1.1" 200 None
2026-03-24 16:54:05 [ayvens.fr] INFO: Saving data for 1977486: {'auction_closing_time': 1774454400.0, 'created_time': 1774284449.761713, 'last_price_update_time': 1774371245.094409}
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977486') HTTP/1.1" 204 0
2026-03-24 16:54:05 [ayvens.fr] INFO: Found listing with ID: 1977487
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977487%27 HTTP/1.1" 200 None
2026-03-24 16:54:05 [ayvens.fr] INFO: Scrape type for 1977487: 2
2026-03-24 16:54:05 [ayvens.fr] INFO: Extracting data for car ID: 1977487
2026-03-24 16:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd with identifier: 1977487
2026-03-24 16:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd with scrape type 2
2026-03-24 16:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd with scrape type 2
2026-03-24 16:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd, identifier: 1977487
2026-03-24 16:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd with identifier: 1977487
2026-03-24 16:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd with identifier: 1977487
2026-03-24 16:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 87a378e7-2ec0-5f5c-8ef3-5b21d24164cd with identifier: 1977487 to the API
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'GRIS MAGNETIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '87a378e7-2ec0-5f5c-8ef3-5b21d24164cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'GALAXY',
'odometer': 158935,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-10',
'seats_number': 7,
'seller_name': None,
'title': 'FORD GALAXY Galaxy 2.5 Duratec 190ch Hybrid Titanium Business eCVT',
'transmission': 'automatic',
'trim': 'Galaxy 2.5 Duratec 190ch Hybrid Titanium Business eCVT',
'vin': None,
'year': 2022}
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977487%27 HTTP/1.1" 200 None
2026-03-24 16:54:05 [ayvens.fr] INFO: Saving data for 1977487: {'auction_closing_time': 1774454400.0, 'created_time': 1774284450.541116, 'last_price_update_time': 1774371245.464903}
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977487') HTTP/1.1" 204 0
2026-03-24 16:54:05 [ayvens.fr] INFO: Found listing with ID: 1977488
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977488%27 HTTP/1.1" 200 None
2026-03-24 16:54:05 [ayvens.fr] INFO: Scrape type for 1977488: 2
2026-03-24 16:54:05 [ayvens.fr] INFO: Extracting data for car ID: 1977488
2026-03-24 16:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d90e3ed-3d7a-5d23-9e42-9be9edf33530 with identifier: 1977488
2026-03-24 16:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d90e3ed-3d7a-5d23-9e42-9be9edf33530 with scrape type 2
2026-03-24 16:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d90e3ed-3d7a-5d23-9e42-9be9edf33530 with scrape type 2
2026-03-24 16:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8d90e3ed-3d7a-5d23-9e42-9be9edf33530, identifier: 1977488
2026-03-24 16:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8d90e3ed-3d7a-5d23-9e42-9be9edf33530 with identifier: 1977488
2026-03-24 16:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8d90e3ed-3d7a-5d23-9e42-9be9edf33530 with identifier: 1977488
2026-03-24 16:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8d90e3ed-3d7a-5d23-9e42-9be9edf33530 with identifier: 1977488 to the API
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'PHANTOM BLACK',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '8d90e3ed-3d7a-5d23-9e42-9be9edf33530',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 150292,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 CRDI 136ch Hybrid 48V Creative DCT7',
'transmission': 'automatic',
'trim': 'Tucson 1.6 CRDI 136ch Hybrid 48V Creative DCT7',
'vin': None,
'year': 2022}
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977488%27 HTTP/1.1" 200 None
2026-03-24 16:54:05 [ayvens.fr] INFO: Saving data for 1977488: {'auction_closing_time': 1774454400.0, 'created_time': 1774284452.005001, 'last_price_update_time': 1774371245.92761}
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977488') HTTP/1.1" 204 0
2026-03-24 16:54:05 [ayvens.fr] INFO: Found listing with ID: 1977489
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977489%27 HTTP/1.1" 200 None
2026-03-24 16:54:05 [ayvens.fr] INFO: Scrape type for 1977489: 2
2026-03-24 16:54:05 [ayvens.fr] INFO: Extracting data for car ID: 1977489
2026-03-24 16:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dae3da0-66ac-57d0-bdac-6b6a943029dc with identifier: 1977489
2026-03-24 16:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dae3da0-66ac-57d0-bdac-6b6a943029dc with scrape type 2
2026-03-24 16:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dae3da0-66ac-57d0-bdac-6b6a943029dc with scrape type 2
2026-03-24 16:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2dae3da0-66ac-57d0-bdac-6b6a943029dc, identifier: 1977489
2026-03-24 16:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2dae3da0-66ac-57d0-bdac-6b6a943029dc with identifier: 1977489
2026-03-24 16:54:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2dae3da0-66ac-57d0-bdac-6b6a943029dc with identifier: 1977489
2026-03-24 16:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2dae3da0-66ac-57d0-bdac-6b6a943029dc with identifier: 1977489 to the API
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'GRIS DAUPHIN',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '2dae3da0-66ac-57d0-bdac-6b6a943029dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 155445,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 2.0 TDI 150ch Life Plus DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 2.0 TDI 150ch Life Plus DSG7',
'vin': None,
'year': 2023}
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977489%27 HTTP/1.1" 200 None
2026-03-24 16:54:06 [ayvens.fr] INFO: Saving data for 1977489: {'auction_closing_time': 1774454400.0, 'created_time': 1774284453.395792, 'last_price_update_time': 1774371246.42387}
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977489') HTTP/1.1" 204 0
2026-03-24 16:54:06 [ayvens.fr] INFO: Found listing with ID: 1977490
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977490%27 HTTP/1.1" 200 None
2026-03-24 16:54:06 [ayvens.fr] INFO: Scrape type for 1977490: 2
2026-03-24 16:54:06 [ayvens.fr] INFO: Extracting data for car ID: 1977490
2026-03-24 16:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8353fd11-74c9-5186-998d-39ef822053f1 with identifier: 1977490
2026-03-24 16:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8353fd11-74c9-5186-998d-39ef822053f1 with scrape type 2
2026-03-24 16:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8353fd11-74c9-5186-998d-39ef822053f1 with scrape type 2
2026-03-24 16:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8353fd11-74c9-5186-998d-39ef822053f1, identifier: 1977490
2026-03-24 16:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8353fd11-74c9-5186-998d-39ef822053f1 with identifier: 1977490
2026-03-24 16:54:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8353fd11-74c9-5186-998d-39ef822053f1 with identifier: 1977490
2026-03-24 16:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8353fd11-74c9-5186-998d-39ef822053f1 with identifier: 1977490 to the API
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'TITAN DARK GRAY M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8353fd11-74c9-5186-998d-39ef822053f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SUZUKI',
'model': 'S-CROSS',
'odometer': 159823,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'SUZUKI S-CROSS S-Cross 1.5 Dualjet Hybrid 115ch Style Auto Allgrip',
'transmission': 'automatic',
'trim': 'S-Cross 1.5 Dualjet Hybrid 115ch Style Auto Allgrip',
'vin': None,
'year': 2024}
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977490%27 HTTP/1.1" 200 None
2026-03-24 16:54:06 [ayvens.fr] INFO: Saving data for 1977490: {'auction_closing_time': 1774454400.0, 'created_time': 1774284455.086836, 'last_price_update_time': 1774371246.876072}
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977490') HTTP/1.1" 204 0
2026-03-24 16:54:06 [ayvens.fr] INFO: Found listing with ID: 1977491
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977491%27 HTTP/1.1" 200 None
2026-03-24 16:54:06 [ayvens.fr] INFO: Scrape type for 1977491: 2
2026-03-24 16:54:06 [ayvens.fr] INFO: Extracting data for car ID: 1977491
2026-03-24 16:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0049d118-4c78-53dc-b6dc-bee3089ca5ee with identifier: 1977491
2026-03-24 16:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0049d118-4c78-53dc-b6dc-bee3089ca5ee with scrape type 2
2026-03-24 16:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0049d118-4c78-53dc-b6dc-bee3089ca5ee with scrape type 2
2026-03-24 16:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0049d118-4c78-53dc-b6dc-bee3089ca5ee, identifier: 1977491
2026-03-24 16:54:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -4 pages/min), scraped 390 items (at 102 items/min)
2026-03-24 16:54:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 16:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0049d118-4c78-53dc-b6dc-bee3089ca5ee with identifier: 1977491
2026-03-24 16:54:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0049d118-4c78-53dc-b6dc-bee3089ca5ee with identifier: 1977491
2026-03-24 16:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0049d118-4c78-53dc-b6dc-bee3089ca5ee with identifier: 1977491 to the API
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'VERT OLIVINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '0049d118-4c78-53dc-b6dc-bee3089ca5ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 152327,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 110ch S&S Active Pack',
'transmission': 'manual',
'trim': '308 1.2 PureTech 110ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977491%27 HTTP/1.1" 200 None
2026-03-24 16:54:07 [ayvens.fr] INFO: Saving data for 1977491: {'auction_closing_time': 1774454400.0, 'created_time': 1774284456.554599, 'last_price_update_time': 1774371247.319521}
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977491') HTTP/1.1" 204 0
2026-03-24 16:54:07 [ayvens.fr] INFO: Found listing with ID: 1977492
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977492%27 HTTP/1.1" 200 None
2026-03-24 16:54:07 [ayvens.fr] INFO: Scrape type for 1977492: 2
2026-03-24 16:54:07 [ayvens.fr] INFO: Extracting data for car ID: 1977492
2026-03-24 16:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e43838-030d-5ea2-9a9c-98ad8641cc29 with identifier: 1977492
2026-03-24 16:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e43838-030d-5ea2-9a9c-98ad8641cc29 with scrape type 2
2026-03-24 16:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e43838-030d-5ea2-9a9c-98ad8641cc29 with scrape type 2
2026-03-24 16:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 03e43838-030d-5ea2-9a9c-98ad8641cc29, identifier: 1977492
2026-03-24 16:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 03e43838-030d-5ea2-9a9c-98ad8641cc29 with identifier: 1977492
2026-03-24 16:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 03e43838-030d-5ea2-9a9c-98ad8641cc29 with identifier: 1977492
2026-03-24 16:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 03e43838-030d-5ea2-9a9c-98ad8641cc29 with identifier: 1977492 to the API
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'GRIS DAUPHIN',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '03e43838-030d-5ea2-9a9c-98ad8641cc29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 191246,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 1.5 TSI 150ch Life Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 1.5 TSI 150ch Life Business DSG7',
'vin': None,
'year': 2021}
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977492%27 HTTP/1.1" 200 None
2026-03-24 16:54:07 [ayvens.fr] INFO: Saving data for 1977492: {'auction_closing_time': 1774454400.0, 'created_time': 1774284458.074592, 'last_price_update_time': 1774371247.855738}
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977492') HTTP/1.1" 204 0
2026-03-24 16:54:07 [ayvens.fr] INFO: Found listing with ID: 1977493
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977493%27 HTTP/1.1" 200 None
2026-03-24 16:54:07 [ayvens.fr] INFO: Scrape type for 1977493: 2
2026-03-24 16:54:07 [ayvens.fr] INFO: Extracting data for car ID: 1977493
2026-03-24 16:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929 with identifier: 1977493
2026-03-24 16:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929 with scrape type 2
2026-03-24 16:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929 with scrape type 2
2026-03-24 16:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929, identifier: 1977493
2026-03-24 16:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929 with identifier: 1977493
2026-03-24 16:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929 with identifier: 1977493
2026-03-24 16:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929 with identifier: 1977493 to the API
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b79642c5-5d90-5d9b-ab5b-ea3c9e7c5929',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3 AIRCROSS',
'odometer': 184716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 AIRCROSS C3 Aircross BlueHDi 100ch S&S Feel Business '
'E6.d',
'transmission': 'manual',
'trim': 'C3 Aircross BlueHDi 100ch S&S Feel Business E6.d',
'vin': None,
'year': 2020}
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977493%27 HTTP/1.1" 200 None
2026-03-24 16:54:08 [ayvens.fr] INFO: Saving data for 1977493: {'auction_closing_time': 1774454400.0, 'created_time': 1774284459.361229, 'last_price_update_time': 1774371248.288794}
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977493') HTTP/1.1" 204 0
2026-03-24 16:54:08 [ayvens.fr] INFO: Found listing with ID: 1977494
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977494%27 HTTP/1.1" 200 None
2026-03-24 16:54:08 [ayvens.fr] INFO: Scrape type for 1977494: 2
2026-03-24 16:54:08 [ayvens.fr] INFO: Extracting data for car ID: 1977494
2026-03-24 16:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db92d947-3ddf-5e14-9ed2-b1225c5169c5 with identifier: 1977494
2026-03-24 16:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db92d947-3ddf-5e14-9ed2-b1225c5169c5 with scrape type 2
2026-03-24 16:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db92d947-3ddf-5e14-9ed2-b1225c5169c5 with scrape type 2
2026-03-24 16:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: db92d947-3ddf-5e14-9ed2-b1225c5169c5, identifier: 1977494
2026-03-24 16:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: db92d947-3ddf-5e14-9ed2-b1225c5169c5 with identifier: 1977494
2026-03-24 16:54:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: db92d947-3ddf-5e14-9ed2-b1225c5169c5 with identifier: 1977494
2026-03-24 16:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: db92d947-3ddf-5e14-9ed2-b1225c5169c5 with identifier: 1977494 to the API
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'GRIS PLATINUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'db92d947-3ddf-5e14-9ed2-b1225c5169c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3 AIRCROSS',
'odometer': 184331,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 AIRCROSS C3 Aircross BlueHDi 100ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 Aircross BlueHDi 100ch S&S Feel Business',
'vin': None,
'year': 2020}
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977494%27 HTTP/1.1" 200 None
2026-03-24 16:54:08 [ayvens.fr] INFO: Saving data for 1977494: {'auction_closing_time': 1774454400.0, 'created_time': 1774284460.832406, 'last_price_update_time': 1774371248.668334}
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977494') HTTP/1.1" 204 0
2026-03-24 16:54:08 [ayvens.fr] INFO: Found listing with ID: 1977495
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977495%27 HTTP/1.1" 200 None
2026-03-24 16:54:08 [ayvens.fr] INFO: Scrape type for 1977495: 2
2026-03-24 16:54:08 [ayvens.fr] INFO: Extracting data for car ID: 1977495
2026-03-24 16:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20eec623-f8f2-5bb7-8bea-2fb94d4459a6 with identifier: 1977495
2026-03-24 16:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20eec623-f8f2-5bb7-8bea-2fb94d4459a6 with scrape type 2
2026-03-24 16:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20eec623-f8f2-5bb7-8bea-2fb94d4459a6 with scrape type 2
2026-03-24 16:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 20eec623-f8f2-5bb7-8bea-2fb94d4459a6, identifier: 1977495
2026-03-24 16:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 20eec623-f8f2-5bb7-8bea-2fb94d4459a6 with identifier: 1977495
2026-03-24 16:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 20eec623-f8f2-5bb7-8bea-2fb94d4459a6 with identifier: 1977495
2026-03-24 16:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 20eec623-f8f2-5bb7-8bea-2fb94d4459a6 with identifier: 1977495 to the API
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '20eec623-f8f2-5bb7-8bea-2fb94d4459a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 169730,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.5 Blue dCi 115ch Business',
'transmission': 'manual',
'trim': 'Megane 1.5 Blue dCi 115ch Business',
'vin': None,
'year': 2020}
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977495%27 HTTP/1.1" 200 None
2026-03-24 16:54:09 [ayvens.fr] INFO: Saving data for 1977495: {'auction_closing_time': 1774454400.0, 'created_time': 1774284462.098651, 'last_price_update_time': 1774371249.009796}
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977495') HTTP/1.1" 204 0
2026-03-24 16:54:09 [ayvens.fr] INFO: Found listing with ID: 1977496
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977496%27 HTTP/1.1" 200 None
2026-03-24 16:54:09 [ayvens.fr] INFO: Scrape type for 1977496: 2
2026-03-24 16:54:09 [ayvens.fr] INFO: Extracting data for car ID: 1977496
2026-03-24 16:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd18952f-2cb4-55de-9fa3-fb6c675d70b9 with identifier: 1977496
2026-03-24 16:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd18952f-2cb4-55de-9fa3-fb6c675d70b9 with scrape type 2
2026-03-24 16:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd18952f-2cb4-55de-9fa3-fb6c675d70b9 with scrape type 2
2026-03-24 16:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bd18952f-2cb4-55de-9fa3-fb6c675d70b9, identifier: 1977496
2026-03-24 16:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bd18952f-2cb4-55de-9fa3-fb6c675d70b9 with identifier: 1977496
2026-03-24 16:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bd18952f-2cb4-55de-9fa3-fb6c675d70b9 with identifier: 1977496
2026-03-24 16:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bd18952f-2cb4-55de-9fa3-fb6c675d70b9 with identifier: 1977496 to the API
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'bd18952f-2cb4-55de-9fa3-fb6c675d70b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 171007,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.5 Blue dCi 115ch Business',
'transmission': 'manual',
'trim': 'Megane 1.5 Blue dCi 115ch Business',
'vin': None,
'year': 2022}
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977496%27 HTTP/1.1" 200 None
2026-03-24 16:54:09 [ayvens.fr] INFO: Saving data for 1977496: {'auction_closing_time': 1774454400.0, 'created_time': 1774284463.52642, 'last_price_update_time': 1774371249.388969}
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977496') HTTP/1.1" 204 0
2026-03-24 16:54:09 [ayvens.fr] INFO: Found listing with ID: 1977497
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977497%27 HTTP/1.1" 200 None
2026-03-24 16:54:09 [ayvens.fr] INFO: Scrape type for 1977497: 2
2026-03-24 16:54:09 [ayvens.fr] INFO: Extracting data for car ID: 1977497
2026-03-24 16:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a with identifier: 1977497
2026-03-24 16:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a with scrape type 2
2026-03-24 16:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a with scrape type 2
2026-03-24 16:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a, identifier: 1977497
2026-03-24 16:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a with identifier: 1977497
2026-03-24 16:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a with identifier: 1977497
2026-03-24 16:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a with identifier: 1977497 to the API
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '3f00baa2-fd5f-5bfd-bfe5-b95c8a7f5d6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 155849,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977497%27 HTTP/1.1" 200 None
2026-03-24 16:54:09 [ayvens.fr] INFO: Saving data for 1977497: {'auction_closing_time': 1774454400.0, 'created_time': 1774284464.852251, 'last_price_update_time': 1774371249.755409}
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977497') HTTP/1.1" 204 0
2026-03-24 16:54:09 [ayvens.fr] INFO: Found listing with ID: 1977498
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977498%27 HTTP/1.1" 200 None
2026-03-24 16:54:09 [ayvens.fr] INFO: Scrape type for 1977498: 2
2026-03-24 16:54:09 [ayvens.fr] INFO: Extracting data for car ID: 1977498
2026-03-24 16:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af755422-ae9c-5677-b90d-8a17430cdef9 with identifier: 1977498
2026-03-24 16:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af755422-ae9c-5677-b90d-8a17430cdef9 with scrape type 2
2026-03-24 16:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af755422-ae9c-5677-b90d-8a17430cdef9 with scrape type 2
2026-03-24 16:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: af755422-ae9c-5677-b90d-8a17430cdef9, identifier: 1977498
2026-03-24 16:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: af755422-ae9c-5677-b90d-8a17430cdef9 with identifier: 1977498
2026-03-24 16:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: af755422-ae9c-5677-b90d-8a17430cdef9 with identifier: 1977498
2026-03-24 16:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: af755422-ae9c-5677-b90d-8a17430cdef9 with identifier: 1977498 to the API
2026-03-24 16:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 95,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'af755422-ae9c-5677-b90d-8a17430cdef9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 150340,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech 145ch full hybrid Evolution',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech 145ch full hybrid Evolution',
'vin': None,
'year': 2023}
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977498%27 HTTP/1.1" 200 None
2026-03-24 16:54:10 [ayvens.fr] INFO: Saving data for 1977498: {'auction_closing_time': 1774454400.0, 'created_time': 1774284466.978725, 'last_price_update_time': 1774371250.112807}
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977498') HTTP/1.1" 204 0
2026-03-24 16:54:10 [ayvens.fr] INFO: Found listing with ID: 1977499
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977499%27 HTTP/1.1" 200 None
2026-03-24 16:54:10 [ayvens.fr] INFO: Scrape type for 1977499: 2
2026-03-24 16:54:10 [ayvens.fr] INFO: Extracting data for car ID: 1977499
2026-03-24 16:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eaf25be-6671-5b5e-90cb-3f040adafc4f with identifier: 1977499
2026-03-24 16:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eaf25be-6671-5b5e-90cb-3f040adafc4f with scrape type 2
2026-03-24 16:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eaf25be-6671-5b5e-90cb-3f040adafc4f with scrape type 2
2026-03-24 16:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9eaf25be-6671-5b5e-90cb-3f040adafc4f, identifier: 1977499
2026-03-24 16:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9eaf25be-6671-5b5e-90cb-3f040adafc4f with identifier: 1977499
2026-03-24 16:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9eaf25be-6671-5b5e-90cb-3f040adafc4f with identifier: 1977499
2026-03-24 16:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9eaf25be-6671-5b5e-90cb-3f040adafc4f with identifier: 1977499 to the API
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '9eaf25be-6671-5b5e-90cb-3f040adafc4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 157731,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977499%27 HTTP/1.1" 200 None
2026-03-24 16:54:10 [ayvens.fr] INFO: Saving data for 1977499: {'auction_closing_time': 1774454400.0, 'created_time': 1774284468.746114, 'last_price_update_time': 1774371250.520608}
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977499') HTTP/1.1" 204 0
2026-03-24 16:54:10 [ayvens.fr] INFO: Found listing with ID: 1977500
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977500%27 HTTP/1.1" 200 None
2026-03-24 16:54:10 [ayvens.fr] INFO: Scrape type for 1977500: 2
2026-03-24 16:54:10 [ayvens.fr] INFO: Extracting data for car ID: 1977500
2026-03-24 16:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3702db8e-a9db-595a-a5e9-d1933174d62c with identifier: 1977500
2026-03-24 16:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3702db8e-a9db-595a-a5e9-d1933174d62c with scrape type 2
2026-03-24 16:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3702db8e-a9db-595a-a5e9-d1933174d62c with scrape type 2
2026-03-24 16:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3702db8e-a9db-595a-a5e9-d1933174d62c, identifier: 1977500
2026-03-24 16:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3702db8e-a9db-595a-a5e9-d1933174d62c with identifier: 1977500
2026-03-24 16:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3702db8e-a9db-595a-a5e9-d1933174d62c with identifier: 1977500
2026-03-24 16:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3702db8e-a9db-595a-a5e9-d1933174d62c with identifier: 1977500 to the API
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': '3702db8e-a9db-595a-a5e9-d1933174d62c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 150478,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 HYBRID 225ch GT e-EAT8',
'transmission': 'automatic',
'trim': '3008 HYBRID 225ch GT e-EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977500%27 HTTP/1.1" 200 None
2026-03-24 16:54:10 [ayvens.fr] INFO: Saving data for 1977500: {'auction_closing_time': 1774454400.0, 'created_time': 1774284470.629657, 'last_price_update_time': 1774371250.983231}
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977500') HTTP/1.1" 204 0
2026-03-24 16:54:10 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-24 16:54:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 16:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 16:54:16 [ayvens.fr] INFO: Found listing with ID: 1977501
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977501%27 HTTP/1.1" 200 None
2026-03-24 16:54:16 [ayvens.fr] INFO: Scrape type for 1977501: 2
2026-03-24 16:54:16 [ayvens.fr] INFO: Extracting data for car ID: 1977501
2026-03-24 16:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f0665b-5324-5f7d-b3d3-83afda8d8fa9 with identifier: 1977501
2026-03-24 16:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f0665b-5324-5f7d-b3d3-83afda8d8fa9 with scrape type 2
2026-03-24 16:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f0665b-5324-5f7d-b3d3-83afda8d8fa9 with scrape type 2
2026-03-24 16:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 42f0665b-5324-5f7d-b3d3-83afda8d8fa9, identifier: 1977501
2026-03-24 16:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 42f0665b-5324-5f7d-b3d3-83afda8d8fa9 with identifier: 1977501
2026-03-24 16:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 42f0665b-5324-5f7d-b3d3-83afda8d8fa9 with identifier: 1977501
2026-03-24 16:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 42f0665b-5324-5f7d-b3d3-83afda8d8fa9 with identifier: 1977501 to the API
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '42f0665b-5324-5f7d-b3d3-83afda8d8fa9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 157207,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN POLO Polo 1.0 TSI 95ch Life Business',
'transmission': 'manual',
'trim': 'Polo 1.0 TSI 95ch Life Business',
'vin': None,
'year': 2022}
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977501%27 HTTP/1.1" 200 None
2026-03-24 16:54:16 [ayvens.fr] INFO: Saving data for 1977501: {'auction_closing_time': 1774454400.0, 'created_time': 1774284471.590352, 'last_price_update_time': 1774371256.931088}
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977501') HTTP/1.1" 204 0
2026-03-24 16:54:16 [ayvens.fr] INFO: Found listing with ID: 1977502
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977502%27 HTTP/1.1" 200 None
2026-03-24 16:54:16 [ayvens.fr] INFO: Scrape type for 1977502: 2
2026-03-24 16:54:16 [ayvens.fr] INFO: Extracting data for car ID: 1977502
2026-03-24 16:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8 with identifier: 1977502
2026-03-24 16:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8 with scrape type 2
2026-03-24 16:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8 with scrape type 2
2026-03-24 16:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8, identifier: 1977502
2026-03-24 16:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8 with identifier: 1977502
2026-03-24 16:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8 with identifier: 1977502
2026-03-24 16:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8 with identifier: 1977502 to the API
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0ee5fb86-4be0-5e3d-91b1-1bfacbafe1b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 157100,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-19',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 1000kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 1000kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2020}
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977502%27 HTTP/1.1" 200 None
2026-03-24 16:54:17 [ayvens.fr] INFO: Saving data for 1977502: {'auction_closing_time': 1774454400.0, 'created_time': 1774284473.58297, 'last_price_update_time': 1774371257.828704}
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977502') HTTP/1.1" 204 0
2026-03-24 16:54:17 [ayvens.fr] INFO: Found listing with ID: 1977503
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977503%27 HTTP/1.1" 200 None
2026-03-24 16:54:17 [ayvens.fr] INFO: Scrape type for 1977503: 2
2026-03-24 16:54:17 [ayvens.fr] INFO: Extracting data for car ID: 1977503
2026-03-24 16:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e735e04-f9db-5fdf-aace-9533ff8c8574 with identifier: 1977503
2026-03-24 16:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e735e04-f9db-5fdf-aace-9533ff8c8574 with scrape type 2
2026-03-24 16:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e735e04-f9db-5fdf-aace-9533ff8c8574 with scrape type 2
2026-03-24 16:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7e735e04-f9db-5fdf-aace-9533ff8c8574, identifier: 1977503
2026-03-24 16:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7e735e04-f9db-5fdf-aace-9533ff8c8574 with identifier: 1977503
2026-03-24 16:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7e735e04-f9db-5fdf-aace-9533ff8c8574 with identifier: 1977503
2026-03-24 16:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7e735e04-f9db-5fdf-aace-9533ff8c8574 with identifier: 1977503 to the API
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 266,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '7e735e04-f9db-5fdf-aace-9533ff8c8574',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 199110,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-22',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3500 L3H3 2.3 dCi 150ch Energy Grand '
'Confort E6',
'transmission': 'manual',
'trim': 'Master Fg F3500 L3H3 2.3 dCi 150ch Energy Grand Confort E6',
'vin': None,
'year': 2021}
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977503%27 HTTP/1.1" 200 None
2026-03-24 16:54:18 [ayvens.fr] INFO: Saving data for 1977503: {'auction_closing_time': 1774454400.0, 'created_time': 1774284474.293349, 'last_price_update_time': 1774371258.448567}
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977503') HTTP/1.1" 204 0
2026-03-24 16:54:18 [ayvens.fr] INFO: Found listing with ID: 1977504
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977504%27 HTTP/1.1" 200 None
2026-03-24 16:54:18 [ayvens.fr] INFO: Scrape type for 1977504: 2
2026-03-24 16:54:18 [ayvens.fr] INFO: Extracting data for car ID: 1977504
2026-03-24 16:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b288cda-d929-574b-aab5-7f03a75efa59 with identifier: 1977504
2026-03-24 16:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b288cda-d929-574b-aab5-7f03a75efa59 with scrape type 2
2026-03-24 16:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b288cda-d929-574b-aab5-7f03a75efa59 with scrape type 2
2026-03-24 16:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7b288cda-d929-574b-aab5-7f03a75efa59, identifier: 1977504
2026-03-24 16:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7b288cda-d929-574b-aab5-7f03a75efa59 with identifier: 1977504
2026-03-24 16:54:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7b288cda-d929-574b-aab5-7f03a75efa59 with identifier: 1977504
2026-03-24 16:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7b288cda-d929-574b-aab5-7f03a75efa59 with identifier: 1977504 to the API
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLEU LAVE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '7b288cda-d929-574b-aab5-7f03a75efa59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SUPERB COMBI',
'odometer': 179473,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SUPERB COMBI Superb Combi2.0 TDI 150ch SCR Style DSG7',
'transmission': 'automatic',
'trim': 'Superb Combi2.0 TDI 150ch SCR Style DSG7',
'vin': None,
'year': 2022}
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977504%27 HTTP/1.1" 200 None
2026-03-24 16:54:18 [ayvens.fr] INFO: Saving data for 1977504: {'auction_closing_time': 1774454400.0, 'created_time': 1774284477.444184, 'last_price_update_time': 1774371258.837982}
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977504') HTTP/1.1" 204 0
2026-03-24 16:54:18 [ayvens.fr] INFO: Found listing with ID: 1977505
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977505%27 HTTP/1.1" 200 None
2026-03-24 16:54:18 [ayvens.fr] INFO: Scrape type for 1977505: 2
2026-03-24 16:54:18 [ayvens.fr] INFO: Extracting data for car ID: 1977505
2026-03-24 16:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba915ab9-a903-5367-ab07-547f27f9fa4d with identifier: 1977505
2026-03-24 16:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba915ab9-a903-5367-ab07-547f27f9fa4d with scrape type 2
2026-03-24 16:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba915ab9-a903-5367-ab07-547f27f9fa4d with scrape type 2
2026-03-24 16:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ba915ab9-a903-5367-ab07-547f27f9fa4d, identifier: 1977505
2026-03-24 16:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ba915ab9-a903-5367-ab07-547f27f9fa4d with identifier: 1977505
2026-03-24 16:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ba915ab9-a903-5367-ab07-547f27f9fa4d with identifier: 1977505
2026-03-24 16:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ba915ab9-a903-5367-ab07-547f27f9fa4d with identifier: 1977505 to the API
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'GRIS ATLAS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'ba915ab9-a903-5367-ab07-547f27f9fa4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'C-HR',
'odometer': 159968,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA C-HR C-HR 122h Dynamic Business 2WD E-CVT',
'transmission': 'automatic',
'trim': 'C-HR 122h Dynamic Business 2WD E-CVT',
'vin': None,
'year': 2019}
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977505%27 HTTP/1.1" 200 None
2026-03-24 16:54:19 [ayvens.fr] INFO: Saving data for 1977505: {'auction_closing_time': 1774454400.0, 'created_time': 1774284478.967611, 'last_price_update_time': 1774371259.324506}
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977505') HTTP/1.1" 204 0
2026-03-24 16:54:19 [ayvens.fr] INFO: Found listing with ID: 1977506
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977506%27 HTTP/1.1" 200 None
2026-03-24 16:54:19 [ayvens.fr] INFO: Scrape type for 1977506: 2
2026-03-24 16:54:19 [ayvens.fr] INFO: Extracting data for car ID: 1977506
2026-03-24 16:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a2f861-9f51-5d1a-8bbe-1d3d7161387a with identifier: 1977506
2026-03-24 16:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a2f861-9f51-5d1a-8bbe-1d3d7161387a with scrape type 2
2026-03-24 16:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a2f861-9f51-5d1a-8bbe-1d3d7161387a with scrape type 2
2026-03-24 16:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d8a2f861-9f51-5d1a-8bbe-1d3d7161387a, identifier: 1977506
2026-03-24 16:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d8a2f861-9f51-5d1a-8bbe-1d3d7161387a with identifier: 1977506
2026-03-24 16:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d8a2f861-9f51-5d1a-8bbe-1d3d7161387a with identifier: 1977506
2026-03-24 16:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d8a2f861-9f51-5d1a-8bbe-1d3d7161387a with identifier: 1977506 to the API
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC PERLE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.5L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'electric',
'id': 'd8a2f861-9f51-5d1a-8bbe-1d3d7161387a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 159207,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Long-Range Dual Motor AWD',
'transmission': 'automatic',
'trim': 'Model 3 Long-Range Dual Motor AWD',
'vin': None,
'year': 2021}
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977506%27 HTTP/1.1" 200 None
2026-03-24 16:54:19 [ayvens.fr] INFO: Saving data for 1977506: {'auction_closing_time': 1774454400.0, 'created_time': 1774284480.300717, 'last_price_update_time': 1774371259.685605}
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977506') HTTP/1.1" 204 0
2026-03-24 16:54:19 [ayvens.fr] INFO: Found listing with ID: 1977507
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977507%27 HTTP/1.1" 200 None
2026-03-24 16:54:19 [ayvens.fr] INFO: Scrape type for 1977507: 2
2026-03-24 16:54:19 [ayvens.fr] INFO: Extracting data for car ID: 1977507
2026-03-24 16:54:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a7d0b47-f229-5ee0-b46c-6593f6b408e6 with identifier: 1977507
2026-03-24 16:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a7d0b47-f229-5ee0-b46c-6593f6b408e6 with scrape type 2
2026-03-24 16:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a7d0b47-f229-5ee0-b46c-6593f6b408e6 with scrape type 2
2026-03-24 16:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5a7d0b47-f229-5ee0-b46c-6593f6b408e6, identifier: 1977507
2026-03-24 16:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5a7d0b47-f229-5ee0-b46c-6593f6b408e6 with identifier: 1977507
2026-03-24 16:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5a7d0b47-f229-5ee0-b46c-6593f6b408e6 with identifier: 1977507
2026-03-24 16:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5a7d0b47-f229-5ee0-b46c-6593f6b408e6 with identifier: 1977507 to the API
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 196,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '5a7d0b47-f229-5ee0-b46c-6593f6b408e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'PROACE',
'odometer': 145706,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-31',
'seats_number': 3,
'seller_name': None,
'title': 'TOYOTA PROACE PROACE Medium 2.0 D-4D 140 Business BVA RC23',
'transmission': 'automatic',
'trim': 'PROACE Medium 2.0 D-4D 140 Business BVA RC23',
'vin': None,
'year': 2023}
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977507%27 HTTP/1.1" 200 None
2026-03-24 16:54:20 [ayvens.fr] INFO: Saving data for 1977507: {'auction_closing_time': 1774454400.0, 'created_time': 1774284482.011974, 'last_price_update_time': 1774371260.073507}
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977507') HTTP/1.1" 204 0
2026-03-24 16:54:20 [ayvens.fr] INFO: Found listing with ID: 1977508
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977508%27 HTTP/1.1" 200 None
2026-03-24 16:54:20 [ayvens.fr] INFO: Scrape type for 1977508: 2
2026-03-24 16:54:20 [ayvens.fr] INFO: Extracting data for car ID: 1977508
2026-03-24 16:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 945833e8-a31d-5bec-b044-7c9b7ae6c788 with identifier: 1977508
2026-03-24 16:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 945833e8-a31d-5bec-b044-7c9b7ae6c788 with scrape type 2
2026-03-24 16:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 945833e8-a31d-5bec-b044-7c9b7ae6c788 with scrape type 2
2026-03-24 16:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 945833e8-a31d-5bec-b044-7c9b7ae6c788, identifier: 1977508
2026-03-24 16:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 945833e8-a31d-5bec-b044-7c9b7ae6c788 with identifier: 1977508
2026-03-24 16:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 945833e8-a31d-5bec-b044-7c9b7ae6c788 with identifier: 1977508
2026-03-24 16:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 945833e8-a31d-5bec-b044-7c9b7ae6c788 with identifier: 1977508 to the API
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '945833e8-a31d-5bec-b044-7c9b7ae6c788',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 188837,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-08',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt',
'vin': None,
'year': 2021}
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977508%27 HTTP/1.1" 200 None
2026-03-24 16:54:20 [ayvens.fr] INFO: Saving data for 1977508: {'auction_closing_time': 1774454400.0, 'created_time': 1774284483.486179, 'last_price_update_time': 1774371260.428669}
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977508') HTTP/1.1" 204 0
2026-03-24 16:54:20 [ayvens.fr] INFO: Found listing with ID: 1977509
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977509%27 HTTP/1.1" 200 None
2026-03-24 16:54:20 [ayvens.fr] INFO: Scrape type for 1977509: 2
2026-03-24 16:54:20 [ayvens.fr] INFO: Extracting data for car ID: 1977509
2026-03-24 16:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343664eb-419c-5d33-a3c4-1c605b11ea6e with identifier: 1977509
2026-03-24 16:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343664eb-419c-5d33-a3c4-1c605b11ea6e with scrape type 2
2026-03-24 16:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343664eb-419c-5d33-a3c4-1c605b11ea6e with scrape type 2
2026-03-24 16:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 343664eb-419c-5d33-a3c4-1c605b11ea6e, identifier: 1977509
2026-03-24 16:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 343664eb-419c-5d33-a3c4-1c605b11ea6e with identifier: 1977509
2026-03-24 16:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 343664eb-419c-5d33-a3c4-1c605b11ea6e with identifier: 1977509
2026-03-24 16:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 343664eb-419c-5d33-a3c4-1c605b11ea6e with identifier: 1977509 to the API
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '343664eb-419c-5d33-a3c4-1c605b11ea6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 175567,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977509%27 HTTP/1.1" 200 None
2026-03-24 16:54:20 [ayvens.fr] INFO: Saving data for 1977509: {'auction_closing_time': 1774454400.0, 'created_time': 1774284484.980777, 'last_price_update_time': 1774371260.804827}
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977509') HTTP/1.1" 204 0
2026-03-24 16:54:20 [ayvens.fr] INFO: Found listing with ID: 1977510
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977510%27 HTTP/1.1" 200 None
2026-03-24 16:54:20 [ayvens.fr] INFO: Scrape type for 1977510: 2
2026-03-24 16:54:20 [ayvens.fr] INFO: Extracting data for car ID: 1977510
2026-03-24 16:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7c19a5-0fe2-535c-9912-3b00ac877c6f with identifier: 1977510
2026-03-24 16:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7c19a5-0fe2-535c-9912-3b00ac877c6f with scrape type 2
2026-03-24 16:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7c19a5-0fe2-535c-9912-3b00ac877c6f with scrape type 2
2026-03-24 16:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ef7c19a5-0fe2-535c-9912-3b00ac877c6f, identifier: 1977510
2026-03-24 16:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ef7c19a5-0fe2-535c-9912-3b00ac877c6f with identifier: 1977510
2026-03-24 16:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ef7c19a5-0fe2-535c-9912-3b00ac877c6f with identifier: 1977510
2026-03-24 16:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ef7c19a5-0fe2-535c-9912-3b00ac877c6f with identifier: 1977510 to the API
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'ef7c19a5-0fe2-535c-9912-3b00ac877c6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'EXPRESS',
'odometer': 170294,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT EXPRESS Express Van 1.5 Blue dCi 95ch Confort',
'transmission': 'manual',
'trim': 'Express Van 1.5 Blue dCi 95ch Confort',
'vin': None,
'year': 2022}
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977510%27 HTTP/1.1" 200 None
2026-03-24 16:54:21 [ayvens.fr] INFO: Saving data for 1977510: {'auction_closing_time': 1774454400.0, 'created_time': 1774284486.279438, 'last_price_update_time': 1774371261.328971}
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977510') HTTP/1.1" 204 0
2026-03-24 16:54:21 [ayvens.fr] INFO: Found listing with ID: 1977511
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977511%27 HTTP/1.1" 200 None
2026-03-24 16:54:21 [ayvens.fr] INFO: Scrape type for 1977511: 2
2026-03-24 16:54:21 [ayvens.fr] INFO: Extracting data for car ID: 1977511
2026-03-24 16:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c8b2bed-5fd1-5d08-b39f-c479d66bec56 with identifier: 1977511
2026-03-24 16:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c8b2bed-5fd1-5d08-b39f-c479d66bec56 with scrape type 2
2026-03-24 16:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c8b2bed-5fd1-5d08-b39f-c479d66bec56 with scrape type 2
2026-03-24 16:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7c8b2bed-5fd1-5d08-b39f-c479d66bec56, identifier: 1977511
2026-03-24 16:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7c8b2bed-5fd1-5d08-b39f-c479d66bec56 with identifier: 1977511
2026-03-24 16:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7c8b2bed-5fd1-5d08-b39f-c479d66bec56 with identifier: 1977511
2026-03-24 16:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7c8b2bed-5fd1-5d08-b39f-c479d66bec56 with identifier: 1977511 to the API
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '7c8b2bed-5fd1-5d08-b39f-c479d66bec56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4',
'odometer': 178829,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 C4 PureTech 100ch S&S Feel',
'transmission': 'manual',
'trim': 'C4 PureTech 100ch S&S Feel',
'vin': None,
'year': 2023}
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977511%27 HTTP/1.1" 200 None
2026-03-24 16:54:21 [ayvens.fr] INFO: Saving data for 1977511: {'auction_closing_time': 1774454400.0, 'created_time': 1774284487.611455, 'last_price_update_time': 1774371261.688545}
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977511') HTTP/1.1" 204 0
2026-03-24 16:54:21 [ayvens.fr] INFO: Found listing with ID: 1977512
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977512%27 HTTP/1.1" 200 None
2026-03-24 16:54:21 [ayvens.fr] INFO: Scrape type for 1977512: 2
2026-03-24 16:54:21 [ayvens.fr] INFO: Extracting data for car ID: 1977512
2026-03-24 16:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f06b282-79ff-5517-9389-2212aeded26d with identifier: 1977512
2026-03-24 16:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f06b282-79ff-5517-9389-2212aeded26d with scrape type 2
2026-03-24 16:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f06b282-79ff-5517-9389-2212aeded26d with scrape type 2
2026-03-24 16:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3f06b282-79ff-5517-9389-2212aeded26d, identifier: 1977512
2026-03-24 16:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3f06b282-79ff-5517-9389-2212aeded26d with identifier: 1977512
2026-03-24 16:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3f06b282-79ff-5517-9389-2212aeded26d with identifier: 1977512
2026-03-24 16:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3f06b282-79ff-5517-9389-2212aeded26d with identifier: 1977512 to the API
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '3f06b282-79ff-5517-9389-2212aeded26d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'RIO',
'odometer': 141208,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'KIA RIO Rio 1.0 T-GDI 100ch Active Business',
'transmission': 'manual',
'trim': 'Rio 1.0 T-GDI 100ch Active Business',
'vin': None,
'year': 2022}
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977512%27 HTTP/1.1" 200 None
2026-03-24 16:54:22 [ayvens.fr] INFO: Saving data for 1977512: {'auction_closing_time': 1774454400.0, 'created_time': 1774284489.471567, 'last_price_update_time': 1774371262.098145}
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977512') HTTP/1.1" 204 0
2026-03-24 16:54:22 [ayvens.fr] INFO: Found listing with ID: 1977513
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977513%27 HTTP/1.1" 200 None
2026-03-24 16:54:22 [ayvens.fr] INFO: Scrape type for 1977513: 2
2026-03-24 16:54:22 [ayvens.fr] INFO: Extracting data for car ID: 1977513
2026-03-24 16:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e7dc2f-81db-59b0-a8a0-27c00b534175 with identifier: 1977513
2026-03-24 16:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e7dc2f-81db-59b0-a8a0-27c00b534175 with scrape type 2
2026-03-24 16:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e7dc2f-81db-59b0-a8a0-27c00b534175 with scrape type 2
2026-03-24 16:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b4e7dc2f-81db-59b0-a8a0-27c00b534175, identifier: 1977513
2026-03-24 16:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b4e7dc2f-81db-59b0-a8a0-27c00b534175 with identifier: 1977513
2026-03-24 16:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b4e7dc2f-81db-59b0-a8a0-27c00b534175 with identifier: 1977513
2026-03-24 16:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b4e7dc2f-81db-59b0-a8a0-27c00b534175 with identifier: 1977513 to the API
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b4e7dc2f-81db-59b0-a8a0-27c00b534175',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 5',
'odometer': 165207,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 5 Serie 5 Touring 530dA xDrive 286ch Lounge Steptronic',
'transmission': 'automatic',
'trim': 'Serie 5 Touring 530dA xDrive 286ch Lounge Steptronic',
'vin': None,
'year': 2021}
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977513%27 HTTP/1.1" 200 None
2026-03-24 16:54:22 [ayvens.fr] INFO: Saving data for 1977513: {'auction_closing_time': 1774454400.0, 'created_time': 1774284490.825304, 'last_price_update_time': 1774371262.478404}
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977513') HTTP/1.1" 204 0
2026-03-24 16:54:22 [ayvens.fr] INFO: Found listing with ID: 1977514
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977514%27 HTTP/1.1" 200 None
2026-03-24 16:54:22 [ayvens.fr] INFO: Scrape type for 1977514: 2
2026-03-24 16:54:22 [ayvens.fr] INFO: Extracting data for car ID: 1977514
2026-03-24 16:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f87de510-b608-5c0d-96bc-8c822b562816 with identifier: 1977514
2026-03-24 16:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f87de510-b608-5c0d-96bc-8c822b562816 with scrape type 2
2026-03-24 16:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f87de510-b608-5c0d-96bc-8c822b562816 with scrape type 2
2026-03-24 16:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f87de510-b608-5c0d-96bc-8c822b562816, identifier: 1977514
2026-03-24 16:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f87de510-b608-5c0d-96bc-8c822b562816 with identifier: 1977514
2026-03-24 16:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f87de510-b608-5c0d-96bc-8c822b562816 with identifier: 1977514
2026-03-24 16:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f87de510-b608-5c0d-96bc-8c822b562816 with identifier: 1977514 to the API
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 112,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'f87de510-b608-5c0d-96bc-8c822b562816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 156896,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-03',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KADJAR Kadjar 1.5 Blue dCi 115ch Business',
'transmission': 'manual',
'trim': 'Kadjar 1.5 Blue dCi 115ch Business',
'vin': None,
'year': 2020}
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977514%27 HTTP/1.1" 200 None
2026-03-24 16:54:22 [ayvens.fr] INFO: Saving data for 1977514: {'auction_closing_time': 1774454400.0, 'created_time': 1774284492.339259, 'last_price_update_time': 1774371262.918495}
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977514') HTTP/1.1" 204 0
2026-03-24 16:54:22 [ayvens.fr] INFO: Found listing with ID: 1977515
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977515%27 HTTP/1.1" 200 None
2026-03-24 16:54:22 [ayvens.fr] INFO: Scrape type for 1977515: 2
2026-03-24 16:54:22 [ayvens.fr] INFO: Extracting data for car ID: 1977515
2026-03-24 16:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666f6d87-34f1-5588-ab04-0bb52fd0adb6 with identifier: 1977515
2026-03-24 16:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666f6d87-34f1-5588-ab04-0bb52fd0adb6 with scrape type 2
2026-03-24 16:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 666f6d87-34f1-5588-ab04-0bb52fd0adb6 with scrape type 2
2026-03-24 16:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 666f6d87-34f1-5588-ab04-0bb52fd0adb6, identifier: 1977515
2026-03-24 16:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 666f6d87-34f1-5588-ab04-0bb52fd0adb6 with identifier: 1977515
2026-03-24 16:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 666f6d87-34f1-5588-ab04-0bb52fd0adb6 with identifier: 1977515
2026-03-24 16:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 666f6d87-34f1-5588-ab04-0bb52fd0adb6 with identifier: 1977515 to the API
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '666f6d87-34f1-5588-ab04-0bb52fd0adb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 141390,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'vin': None,
'year': 2021}
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977515%27 HTTP/1.1" 200 None
2026-03-24 16:54:23 [ayvens.fr] INFO: Saving data for 1977515: {'auction_closing_time': 1774454400.0, 'created_time': 1774284493.842074, 'last_price_update_time': 1774371263.286961}
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977515') HTTP/1.1" 204 0
2026-03-24 16:54:23 [ayvens.fr] INFO: Found listing with ID: 1977516
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977516%27 HTTP/1.1" 200 None
2026-03-24 16:54:23 [ayvens.fr] INFO: Scrape type for 1977516: 2
2026-03-24 16:54:23 [ayvens.fr] INFO: Extracting data for car ID: 1977516
2026-03-24 16:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81efaf18-249a-5268-9182-6bcaee50fc0d with identifier: 1977516
2026-03-24 16:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81efaf18-249a-5268-9182-6bcaee50fc0d with scrape type 2
2026-03-24 16:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81efaf18-249a-5268-9182-6bcaee50fc0d with scrape type 2
2026-03-24 16:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 81efaf18-249a-5268-9182-6bcaee50fc0d, identifier: 1977516
2026-03-24 16:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 81efaf18-249a-5268-9182-6bcaee50fc0d with identifier: 1977516
2026-03-24 16:54:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 81efaf18-249a-5268-9182-6bcaee50fc0d with identifier: 1977516
2026-03-24 16:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 81efaf18-249a-5268-9182-6bcaee50fc0d with identifier: 1977516 to the API
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'GRIS SELENIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '81efaf18-249a-5268-9182-6bcaee50fc0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 141163,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2024}
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977516%27 HTTP/1.1" 200 None
2026-03-24 16:54:23 [ayvens.fr] INFO: Saving data for 1977516: {'auction_closing_time': 1774454400.0, 'created_time': 1774284495.126098, 'last_price_update_time': 1774371263.656846}
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977516') HTTP/1.1" 204 0
2026-03-24 16:54:23 [ayvens.fr] INFO: Found listing with ID: 1977517
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977517%27 HTTP/1.1" 200 None
2026-03-24 16:54:23 [ayvens.fr] INFO: Scrape type for 1977517: 2
2026-03-24 16:54:23 [ayvens.fr] INFO: Extracting data for car ID: 1977517
2026-03-24 16:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0 with identifier: 1977517
2026-03-24 16:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0 with scrape type 2
2026-03-24 16:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0 with scrape type 2
2026-03-24 16:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0, identifier: 1977517
2026-03-24 16:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0 with identifier: 1977517
2026-03-24 16:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0 with identifier: 1977517
2026-03-24 16:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0 with identifier: 1977517 to the API
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '94179a39-87b7-5c6d-a3d0-54c2aa9f5fd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 153213,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-25',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S GT EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977517%27 HTTP/1.1" 200 None
2026-03-24 16:54:24 [ayvens.fr] INFO: Saving data for 1977517: {'auction_closing_time': 1774454400.0, 'created_time': 1774284496.671166, 'last_price_update_time': 1774371264.027505}
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977517') HTTP/1.1" 204 0
2026-03-24 16:54:24 [ayvens.fr] INFO: Found listing with ID: 1977518
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977518%27 HTTP/1.1" 200 None
2026-03-24 16:54:24 [ayvens.fr] INFO: Scrape type for 1977518: 2
2026-03-24 16:54:24 [ayvens.fr] INFO: Extracting data for car ID: 1977518
2026-03-24 16:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf82164-e119-5f23-a093-1cec186b5e01 with identifier: 1977518
2026-03-24 16:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf82164-e119-5f23-a093-1cec186b5e01 with scrape type 2
2026-03-24 16:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf82164-e119-5f23-a093-1cec186b5e01 with scrape type 2
2026-03-24 16:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fcf82164-e119-5f23-a093-1cec186b5e01, identifier: 1977518
2026-03-24 16:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fcf82164-e119-5f23-a093-1cec186b5e01 with identifier: 1977518
2026-03-24 16:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fcf82164-e119-5f23-a093-1cec186b5e01 with identifier: 1977518
2026-03-24 16:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fcf82164-e119-5f23-a093-1cec186b5e01 with identifier: 1977518 to the API
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'fcf82164-e119-5f23-a093-1cec186b5e01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 172234,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch Active Business S&S EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch Active Business S&S EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977518%27 HTTP/1.1" 200 None
2026-03-24 16:54:24 [ayvens.fr] INFO: Saving data for 1977518: {'auction_closing_time': 1774454400.0, 'created_time': 1774284497.831212, 'last_price_update_time': 1774371264.395814}
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977518') HTTP/1.1" 204 0
2026-03-24 16:54:24 [ayvens.fr] INFO: Found listing with ID: 1977519
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977519%27 HTTP/1.1" 200 None
2026-03-24 16:54:24 [ayvens.fr] INFO: Scrape type for 1977519: 2
2026-03-24 16:54:24 [ayvens.fr] INFO: Extracting data for car ID: 1977519
2026-03-24 16:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7618c86-aa90-51fd-9f14-3556f685ea1c with identifier: 1977519
2026-03-24 16:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7618c86-aa90-51fd-9f14-3556f685ea1c with scrape type 2
2026-03-24 16:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7618c86-aa90-51fd-9f14-3556f685ea1c with scrape type 2
2026-03-24 16:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e7618c86-aa90-51fd-9f14-3556f685ea1c, identifier: 1977519
2026-03-24 16:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e7618c86-aa90-51fd-9f14-3556f685ea1c with identifier: 1977519
2026-03-24 16:54:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e7618c86-aa90-51fd-9f14-3556f685ea1c with identifier: 1977519
2026-03-24 16:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e7618c86-aa90-51fd-9f14-3556f685ea1c with identifier: 1977519 to the API
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': 'GRIS CASSIOPEE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'e7618c86-aa90-51fd-9f14-3556f685ea1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TALISMAN',
'odometer': 172148,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT TALISMAN Talisman 1.3 TCe 160ch FAP Intens EDC',
'transmission': 'automatic',
'trim': 'Talisman 1.3 TCe 160ch FAP Intens EDC',
'vin': None,
'year': 2020}
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977519%27 HTTP/1.1" 200 None
2026-03-24 16:54:24 [ayvens.fr] INFO: Saving data for 1977519: {'auction_closing_time': 1774454400.0, 'created_time': 1774284499.95397, 'last_price_update_time': 1774371264.766172}
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977519') HTTP/1.1" 204 0
2026-03-24 16:54:24 [ayvens.fr] INFO: Found listing with ID: 1977520
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977520%27 HTTP/1.1" 200 None
2026-03-24 16:54:24 [ayvens.fr] INFO: Scrape type for 1977520: 2
2026-03-24 16:54:24 [ayvens.fr] INFO: Extracting data for car ID: 1977520
2026-03-24 16:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d3e42a-5b3d-5d19-a53a-64655acee061 with identifier: 1977520
2026-03-24 16:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d3e42a-5b3d-5d19-a53a-64655acee061 with scrape type 2
2026-03-24 16:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d3e42a-5b3d-5d19-a53a-64655acee061 with scrape type 2
2026-03-24 16:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 50d3e42a-5b3d-5d19-a53a-64655acee061, identifier: 1977520
2026-03-24 16:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 50d3e42a-5b3d-5d19-a53a-64655acee061 with identifier: 1977520
2026-03-24 16:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 50d3e42a-5b3d-5d19-a53a-64655acee061 with identifier: 1977520
2026-03-24 16:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 50d3e42a-5b3d-5d19-a53a-64655acee061 with identifier: 1977520 to the API
2026-03-24 16:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '50d3e42a-5b3d-5d19-a53a-64655acee061',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 163005,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-24',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch E6.c Active Business S&S EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch E6.c Active Business S&S EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977520%27 HTTP/1.1" 200 None
2026-03-24 16:54:25 [ayvens.fr] INFO: Saving data for 1977520: {'auction_closing_time': 1774454400.0, 'created_time': 1774284500.977296, 'last_price_update_time': 1774371265.138397}
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977520') HTTP/1.1" 204 0
2026-03-24 16:54:25 [ayvens.fr] INFO: Found listing with ID: 1977521
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977521%27 HTTP/1.1" 200 None
2026-03-24 16:54:25 [ayvens.fr] INFO: Scrape type for 1977521: 2
2026-03-24 16:54:25 [ayvens.fr] INFO: Extracting data for car ID: 1977521
2026-03-24 16:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b272ae4-590c-5f6e-b2a7-521011d4fdd2 with identifier: 1977521
2026-03-24 16:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b272ae4-590c-5f6e-b2a7-521011d4fdd2 with scrape type 2
2026-03-24 16:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b272ae4-590c-5f6e-b2a7-521011d4fdd2 with scrape type 2
2026-03-24 16:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6b272ae4-590c-5f6e-b2a7-521011d4fdd2, identifier: 1977521
2026-03-24 16:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6b272ae4-590c-5f6e-b2a7-521011d4fdd2 with identifier: 1977521
2026-03-24 16:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6b272ae4-590c-5f6e-b2a7-521011d4fdd2 with identifier: 1977521
2026-03-24 16:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6b272ae4-590c-5f6e-b2a7-521011d4fdd2 with identifier: 1977521 to the API
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': 'BLEU TIJUCA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': '6b272ae4-590c-5f6e-b2a7-521011d4fdd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 181352,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-13',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid 225ch Business e-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid 225ch Business e-EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977521%27 HTTP/1.1" 200 None
2026-03-24 16:54:25 [ayvens.fr] INFO: Saving data for 1977521: {'auction_closing_time': 1774454400.0, 'created_time': 1774284502.385467, 'last_price_update_time': 1774371265.507102}
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977521') HTTP/1.1" 204 0
2026-03-24 16:54:25 [ayvens.fr] INFO: Found listing with ID: 1977522
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977522%27 HTTP/1.1" 200 None
2026-03-24 16:54:25 [ayvens.fr] INFO: Scrape type for 1977522: 2
2026-03-24 16:54:25 [ayvens.fr] INFO: Extracting data for car ID: 1977522
2026-03-24 16:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381 with identifier: 1977522
2026-03-24 16:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381 with scrape type 2
2026-03-24 16:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381 with scrape type 2
2026-03-24 16:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381, identifier: 1977522
2026-03-24 16:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381 with identifier: 1977522
2026-03-24 16:54:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381 with identifier: 1977522
2026-03-24 16:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0b8e703c-4dd9-54ad-bce9-c8b96c9d0381 with identifier: 1977522 to the API
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'MINERAL GRAU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '0b8e703c-4dd9-54ad-bce9-c8b96c9d0381',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 202190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Série 3 Touring 318dA 150ch Business Design',
'transmission': 'automatic',
'trim': 'Série 3 Touring 318dA 150ch Business Design',
'vin': None,
'year': 2022}
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977522%27 HTTP/1.1" 200 None
2026-03-24 16:54:25 [ayvens.fr] INFO: Saving data for 1977522: {'auction_closing_time': 1774454400.0, 'created_time': 1774284504.195158, 'last_price_update_time': 1774371265.878403}
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977522') HTTP/1.1" 204 0
2026-03-24 16:54:25 [ayvens.fr] INFO: Found listing with ID: 1977523
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977523%27 HTTP/1.1" 200 None
2026-03-24 16:54:25 [ayvens.fr] INFO: Scrape type for 1977523: 2
2026-03-24 16:54:25 [ayvens.fr] INFO: Extracting data for car ID: 1977523
2026-03-24 16:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c794e30f-f6f3-516e-9560-a61d07937e0b with identifier: 1977523
2026-03-24 16:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c794e30f-f6f3-516e-9560-a61d07937e0b with scrape type 2
2026-03-24 16:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c794e30f-f6f3-516e-9560-a61d07937e0b with scrape type 2
2026-03-24 16:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c794e30f-f6f3-516e-9560-a61d07937e0b, identifier: 1977523
2026-03-24 16:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c794e30f-f6f3-516e-9560-a61d07937e0b with identifier: 1977523
2026-03-24 16:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c794e30f-f6f3-516e-9560-a61d07937e0b with identifier: 1977523
2026-03-24 16:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c794e30f-f6f3-516e-9560-a61d07937e0b with identifier: 1977523 to the API
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'c794e30f-f6f3-516e-9560-a61d07937e0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SUPERB',
'odometer': 156667,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SUPERB Superb 1.5 TSI ACT 150ch Business DSG7',
'transmission': 'automatic',
'trim': 'Superb 1.5 TSI ACT 150ch Business DSG7',
'vin': None,
'year': 2023}
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977523%27 HTTP/1.1" 200 None
2026-03-24 16:54:26 [ayvens.fr] INFO: Saving data for 1977523: {'auction_closing_time': 1774454400.0, 'created_time': 1774284506.155919, 'last_price_update_time': 1774371266.254329}
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977523') HTTP/1.1" 204 0
2026-03-24 16:54:26 [ayvens.fr] INFO: Found listing with ID: 1977524
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977524%27 HTTP/1.1" 200 None
2026-03-24 16:54:26 [ayvens.fr] INFO: Scrape type for 1977524: 2
2026-03-24 16:54:26 [ayvens.fr] INFO: Extracting data for car ID: 1977524
2026-03-24 16:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc with identifier: 1977524
2026-03-24 16:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc with scrape type 2
2026-03-24 16:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc with scrape type 2
2026-03-24 16:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc, identifier: 1977524
2026-03-24 16:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc with identifier: 1977524
2026-03-24 16:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc with identifier: 1977524
2026-03-24 16:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc with identifier: 1977524 to the API
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'e913c4f9-b1e7-5710-8ae0-bfd21a3fc1fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 184411,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977524%27 HTTP/1.1" 200 None
2026-03-24 16:54:26 [ayvens.fr] INFO: Saving data for 1977524: {'auction_closing_time': 1774454400.0, 'created_time': 1774284507.765623, 'last_price_update_time': 1774371266.637592}
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977524') HTTP/1.1" 204 0
2026-03-24 16:54:26 [ayvens.fr] INFO: Found listing with ID: 1977525
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977525%27 HTTP/1.1" 200 None
2026-03-24 16:54:26 [ayvens.fr] INFO: Scrape type for 1977525: 2
2026-03-24 16:54:26 [ayvens.fr] INFO: Extracting data for car ID: 1977525
2026-03-24 16:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09f4b75a-b51a-5f9b-aed7-4253af2d5b26 with identifier: 1977525
2026-03-24 16:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09f4b75a-b51a-5f9b-aed7-4253af2d5b26 with scrape type 2
2026-03-24 16:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09f4b75a-b51a-5f9b-aed7-4253af2d5b26 with scrape type 2
2026-03-24 16:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 09f4b75a-b51a-5f9b-aed7-4253af2d5b26, identifier: 1977525
2026-03-24 16:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 09f4b75a-b51a-5f9b-aed7-4253af2d5b26 with identifier: 1977525
2026-03-24 16:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 09f4b75a-b51a-5f9b-aed7-4253af2d5b26 with identifier: 1977525
2026-03-24 16:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 09f4b75a-b51a-5f9b-aed7-4253af2d5b26 with identifier: 1977525 to the API
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '09f4b75a-b51a-5f9b-aed7-4253af2d5b26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 167014,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977525%27 HTTP/1.1" 200 None
2026-03-24 16:54:27 [ayvens.fr] INFO: Saving data for 1977525: {'auction_closing_time': 1774454400.0, 'created_time': 1774284509.319465, 'last_price_update_time': 1774371267.078089}
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977525') HTTP/1.1" 204 0
2026-03-24 16:54:27 [ayvens.fr] INFO: Found listing with ID: 1977526
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977526%27 HTTP/1.1" 200 None
2026-03-24 16:54:27 [ayvens.fr] INFO: Scrape type for 1977526: 2
2026-03-24 16:54:27 [ayvens.fr] INFO: Extracting data for car ID: 1977526
2026-03-24 16:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb with identifier: 1977526
2026-03-24 16:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb with scrape type 2
2026-03-24 16:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb with scrape type 2
2026-03-24 16:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb, identifier: 1977526
2026-03-24 16:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb with identifier: 1977526
2026-03-24 16:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb with identifier: 1977526
2026-03-24 16:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3e0bb812-0ddf-5c5e-8292-8e80821e5dfb with identifier: 1977526 to the API
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '3e0bb812-0ddf-5c5e-8292-8e80821e5dfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 177104,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 110ch S&S Active Business',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 110ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977526%27 HTTP/1.1" 200 None
2026-03-24 16:54:27 [ayvens.fr] INFO: Saving data for 1977526: {'auction_closing_time': 1774454400.0, 'created_time': 1774284510.532965, 'last_price_update_time': 1774371267.549919}
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977526') HTTP/1.1" 204 0
2026-03-24 16:54:27 [ayvens.fr] INFO: Found listing with ID: 1977527
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977527%27 HTTP/1.1" 200 None
2026-03-24 16:54:27 [ayvens.fr] INFO: Scrape type for 1977527: 2
2026-03-24 16:54:27 [ayvens.fr] INFO: Extracting data for car ID: 1977527
2026-03-24 16:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 655d546d-b769-5182-a5a9-54b24e988088 with identifier: 1977527
2026-03-24 16:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 655d546d-b769-5182-a5a9-54b24e988088 with scrape type 2
2026-03-24 16:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 655d546d-b769-5182-a5a9-54b24e988088 with scrape type 2
2026-03-24 16:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 655d546d-b769-5182-a5a9-54b24e988088, identifier: 1977527
2026-03-24 16:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 655d546d-b769-5182-a5a9-54b24e988088 with identifier: 1977527
2026-03-24 16:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 655d546d-b769-5182-a5a9-54b24e988088 with identifier: 1977527
2026-03-24 16:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 655d546d-b769-5182-a5a9-54b24e988088 with identifier: 1977527 to the API
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '655d546d-b769-5182-a5a9-54b24e988088',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 169431,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-14',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977527%27 HTTP/1.1" 200 None
2026-03-24 16:54:27 [ayvens.fr] INFO: Saving data for 1977527: {'auction_closing_time': 1774454400.0, 'created_time': 1774284512.471433, 'last_price_update_time': 1774371267.926136}
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977527') HTTP/1.1" 204 0
2026-03-24 16:54:27 [ayvens.fr] INFO: Found listing with ID: 1977528
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977528%27 HTTP/1.1" 200 None
2026-03-24 16:54:27 [ayvens.fr] INFO: Scrape type for 1977528: 2
2026-03-24 16:54:27 [ayvens.fr] INFO: Extracting data for car ID: 1977528
2026-03-24 16:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b26213c-a250-59da-a438-0da9d5f817e1 with identifier: 1977528
2026-03-24 16:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b26213c-a250-59da-a438-0da9d5f817e1 with scrape type 2
2026-03-24 16:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b26213c-a250-59da-a438-0da9d5f817e1 with scrape type 2
2026-03-24 16:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1b26213c-a250-59da-a438-0da9d5f817e1, identifier: 1977528
2026-03-24 16:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1b26213c-a250-59da-a438-0da9d5f817e1 with identifier: 1977528
2026-03-24 16:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1b26213c-a250-59da-a438-0da9d5f817e1 with identifier: 1977528
2026-03-24 16:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1b26213c-a250-59da-a438-0da9d5f817e1 with identifier: 1977528 to the API
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'phev/petrol',
'id': '1b26213c-a250-59da-a438-0da9d5f817e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'XCEED',
'odometer': 171246,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'KIA XCEED XCeed 1.6 GDi 105ch + Plug-In 60.5ch Active Business DCT6',
'transmission': 'automatic',
'trim': 'XCeed 1.6 GDi 105ch + Plug-In 60.5ch Active Business DCT6',
'vin': None,
'year': 2021}
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977528%27 HTTP/1.1" 200 None
2026-03-24 16:54:28 [ayvens.fr] INFO: Saving data for 1977528: {'auction_closing_time': 1774454400.0, 'created_time': 1774284514.123649, 'last_price_update_time': 1774371268.313321}
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977528') HTTP/1.1" 204 0
2026-03-24 16:54:28 [ayvens.fr] INFO: Found listing with ID: 1977529
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977529%27 HTTP/1.1" 200 None
2026-03-24 16:54:28 [ayvens.fr] INFO: Scrape type for 1977529: 2
2026-03-24 16:54:28 [ayvens.fr] INFO: Extracting data for car ID: 1977529
2026-03-24 16:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 874e68a5-37e4-57a4-9ce0-af3c9eb19c78 with identifier: 1977529
2026-03-24 16:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 874e68a5-37e4-57a4-9ce0-af3c9eb19c78 with scrape type 2
2026-03-24 16:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 874e68a5-37e4-57a4-9ce0-af3c9eb19c78 with scrape type 2
2026-03-24 16:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 874e68a5-37e4-57a4-9ce0-af3c9eb19c78, identifier: 1977529
2026-03-24 16:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 874e68a5-37e4-57a4-9ce0-af3c9eb19c78 with identifier: 1977529
2026-03-24 16:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 874e68a5-37e4-57a4-9ce0-af3c9eb19c78 with identifier: 1977529
2026-03-24 16:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 874e68a5-37e4-57a4-9ce0-af3c9eb19c78 with identifier: 1977529 to the API
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 156,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '874e68a5-37e4-57a4-9ce0-af3c9eb19c78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'S-MAX',
'odometer': 189026,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-20',
'seats_number': 2,
'seller_name': None,
'title': 'FORD S-MAX S-MAX 2.0 EcoBlue 150ch Titanium Business - 2 PLACES / 2 '
'SEATS',
'transmission': 'manual',
'trim': 'S-MAX 2.0 EcoBlue 150ch Titanium Business - 2 PLACES / 2 SEATS',
'vin': None,
'year': 2020}
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977529%27 HTTP/1.1" 200 None
2026-03-24 16:54:28 [ayvens.fr] INFO: Saving data for 1977529: {'auction_closing_time': 1774454400.0, 'created_time': 1774284516.071653, 'last_price_update_time': 1774371268.669676}
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977529') HTTP/1.1" 204 0
2026-03-24 16:54:28 [ayvens.fr] INFO: Found listing with ID: 1977530
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977530%27 HTTP/1.1" 200 None
2026-03-24 16:54:28 [ayvens.fr] INFO: Scrape type for 1977530: 2
2026-03-24 16:54:28 [ayvens.fr] INFO: Extracting data for car ID: 1977530
2026-03-24 16:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee with identifier: 1977530
2026-03-24 16:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee with scrape type 2
2026-03-24 16:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee with scrape type 2
2026-03-24 16:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee, identifier: 1977530
2026-03-24 16:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee with identifier: 1977530
2026-03-24 16:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee with identifier: 1977530
2026-03-24 16:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0a8630a1-c6e8-5e6d-818a-8fab84c7aaee with identifier: 1977530 to the API
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 207,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0a8630a1-c6e8-5e6d-818a-8fab84c7aaee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 152830,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3500 L2H2 2.3 dCi 130ch Cabine '
'Approfondie Grand Confort',
'transmission': 'manual',
'trim': 'Master Fg F3500 L2H2 2.3 dCi 130ch Cabine Approfondie Grand Confort',
'vin': None,
'year': 2019}
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977530%27 HTTP/1.1" 200 None
2026-03-24 16:54:29 [ayvens.fr] INFO: Saving data for 1977530: {'auction_closing_time': 1774454400.0, 'created_time': 1774284517.505078, 'last_price_update_time': 1774371269.065555}
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977530') HTTP/1.1" 204 0
2026-03-24 16:54:29 [ayvens.fr] INFO: Found listing with ID: 1977531
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977531%27 HTTP/1.1" 200 None
2026-03-24 16:54:29 [ayvens.fr] INFO: Scrape type for 1977531: 2
2026-03-24 16:54:29 [ayvens.fr] INFO: Extracting data for car ID: 1977531
2026-03-24 16:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099631b1-08ed-5734-bc40-9ff0b6556b51 with identifier: 1977531
2026-03-24 16:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099631b1-08ed-5734-bc40-9ff0b6556b51 with scrape type 2
2026-03-24 16:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 099631b1-08ed-5734-bc40-9ff0b6556b51 with scrape type 2
2026-03-24 16:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 099631b1-08ed-5734-bc40-9ff0b6556b51, identifier: 1977531
2026-03-24 16:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 099631b1-08ed-5734-bc40-9ff0b6556b51 with identifier: 1977531
2026-03-24 16:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 099631b1-08ed-5734-bc40-9ff0b6556b51 with identifier: 1977531
2026-03-24 16:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 099631b1-08ed-5734-bc40-9ff0b6556b51 with identifier: 1977531 to the API
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '099631b1-08ed-5734-bc40-9ff0b6556b51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 174641,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-20',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Long 2.0 BlueHDi 120ch Premium S&S',
'transmission': 'manual',
'trim': 'Expert Fg Long 2.0 BlueHDi 120ch Premium S&S',
'vin': None,
'year': 2017}
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977531%27 HTTP/1.1" 200 None
2026-03-24 16:54:29 [ayvens.fr] INFO: Saving data for 1977531: {'auction_closing_time': 1774454400.0, 'created_time': 1774284519.053157, 'last_price_update_time': 1774371269.444711}
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977531') HTTP/1.1" 204 0
2026-03-24 16:54:29 [ayvens.fr] INFO: Found listing with ID: 1977532
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977532%27 HTTP/1.1" 200 None
2026-03-24 16:54:29 [ayvens.fr] INFO: Scrape type for 1977532: 2
2026-03-24 16:54:29 [ayvens.fr] INFO: Extracting data for car ID: 1977532
2026-03-24 16:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1623c370-fc8a-522d-8360-e17a0fdcf441 with identifier: 1977532
2026-03-24 16:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1623c370-fc8a-522d-8360-e17a0fdcf441 with scrape type 2
2026-03-24 16:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1623c370-fc8a-522d-8360-e17a0fdcf441 with scrape type 2
2026-03-24 16:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1623c370-fc8a-522d-8360-e17a0fdcf441, identifier: 1977532
2026-03-24 16:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1623c370-fc8a-522d-8360-e17a0fdcf441 with identifier: 1977532
2026-03-24 16:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1623c370-fc8a-522d-8360-e17a0fdcf441 with identifier: 1977532
2026-03-24 16:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1623c370-fc8a-522d-8360-e17a0fdcf441 with identifier: 1977532 to the API
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1623c370-fc8a-522d-8360-e17a0fdcf441',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 167458,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-11',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Grand '
'Confort',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Grand Confort',
'vin': None,
'year': 2020}
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977532%27 HTTP/1.1" 200 None
2026-03-24 16:54:29 [ayvens.fr] INFO: Saving data for 1977532: {'auction_closing_time': 1774454400.0, 'created_time': 1774284519.63323, 'last_price_update_time': 1774371269.823051}
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977532') HTTP/1.1" 204 0
2026-03-24 16:54:29 [ayvens.fr] INFO: Found listing with ID: 1977533
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977533%27 HTTP/1.1" 200 None
2026-03-24 16:54:29 [ayvens.fr] INFO: Scrape type for 1977533: 2
2026-03-24 16:54:29 [ayvens.fr] INFO: Extracting data for car ID: 1977533
2026-03-24 16:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0877cbdc-a046-5065-a680-3c19e32ee082 with identifier: 1977533
2026-03-24 16:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0877cbdc-a046-5065-a680-3c19e32ee082 with scrape type 2
2026-03-24 16:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0877cbdc-a046-5065-a680-3c19e32ee082 with scrape type 2
2026-03-24 16:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0877cbdc-a046-5065-a680-3c19e32ee082, identifier: 1977533
2026-03-24 16:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0877cbdc-a046-5065-a680-3c19e32ee082 with identifier: 1977533
2026-03-24 16:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0877cbdc-a046-5065-a680-3c19e32ee082 with identifier: 1977533
2026-03-24 16:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0877cbdc-a046-5065-a680-3c19e32ee082 with identifier: 1977533 to the API
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 189,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0877cbdc-a046-5065-a680-3c19e32ee082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 183439,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-30',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt '
'EAT8',
'transmission': 'automatic',
'trim': 'Expert Fg Standard 2.0 BlueHDi 120ch S&S Asphalt EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977533%27 HTTP/1.1" 200 None
2026-03-24 16:54:30 [ayvens.fr] INFO: Saving data for 1977533: {'auction_closing_time': 1774454400.0, 'created_time': 1774284520.984739, 'last_price_update_time': 1774371270.349441}
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977533') HTTP/1.1" 204 0
2026-03-24 16:54:30 [ayvens.fr] INFO: Found listing with ID: 1977534
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977534%27 HTTP/1.1" 200 None
2026-03-24 16:54:30 [ayvens.fr] INFO: Scrape type for 1977534: 2
2026-03-24 16:54:30 [ayvens.fr] INFO: Extracting data for car ID: 1977534
2026-03-24 16:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b66a6d8-f1c7-50dd-a194-c147a38fdf15 with identifier: 1977534
2026-03-24 16:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b66a6d8-f1c7-50dd-a194-c147a38fdf15 with scrape type 2
2026-03-24 16:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b66a6d8-f1c7-50dd-a194-c147a38fdf15 with scrape type 2
2026-03-24 16:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4b66a6d8-f1c7-50dd-a194-c147a38fdf15, identifier: 1977534
2026-03-24 16:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4b66a6d8-f1c7-50dd-a194-c147a38fdf15 with identifier: 1977534
2026-03-24 16:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4b66a6d8-f1c7-50dd-a194-c147a38fdf15 with identifier: 1977534
2026-03-24 16:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4b66a6d8-f1c7-50dd-a194-c147a38fdf15 with identifier: 1977534 to the API
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '4b66a6d8-f1c7-50dd-a194-c147a38fdf15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 211817,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '308 1.5 BlueHDi 130ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977534%27 HTTP/1.1" 200 None
2026-03-24 16:54:30 [ayvens.fr] INFO: Saving data for 1977534: {'auction_closing_time': 1774454400.0, 'created_time': 1774284522.37983, 'last_price_update_time': 1774371270.717237}
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977534') HTTP/1.1" 204 0
2026-03-24 16:54:30 [ayvens.fr] INFO: Found listing with ID: 1977535
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977535%27 HTTP/1.1" 200 None
2026-03-24 16:54:30 [ayvens.fr] INFO: Scrape type for 1977535: 2
2026-03-24 16:54:30 [ayvens.fr] INFO: Extracting data for car ID: 1977535
2026-03-24 16:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62743d8-83b5-5e99-8e60-ce47c3848dbf with identifier: 1977535
2026-03-24 16:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62743d8-83b5-5e99-8e60-ce47c3848dbf with scrape type 2
2026-03-24 16:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62743d8-83b5-5e99-8e60-ce47c3848dbf with scrape type 2
2026-03-24 16:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c62743d8-83b5-5e99-8e60-ce47c3848dbf, identifier: 1977535
2026-03-24 16:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c62743d8-83b5-5e99-8e60-ce47c3848dbf with identifier: 1977535
2026-03-24 16:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c62743d8-83b5-5e99-8e60-ce47c3848dbf with identifier: 1977535
2026-03-24 16:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c62743d8-83b5-5e99-8e60-ce47c3848dbf with identifier: 1977535 to the API
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 76,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'c62743d8-83b5-5e99-8e60-ce47c3848dbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 156576,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 122h Dynamic Business',
'transmission': 'automatic',
'trim': 'Corolla 122h Dynamic Business',
'vin': None,
'year': 2019}
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977535%27 HTTP/1.1" 200 None
2026-03-24 16:54:31 [ayvens.fr] INFO: Saving data for 1977535: {'auction_closing_time': 1774454400.0, 'created_time': 1774284523.682397, 'last_price_update_time': 1774371271.209445}
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977535') HTTP/1.1" 204 0
2026-03-24 16:54:31 [ayvens.fr] INFO: Found listing with ID: 1977536
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977536%27 HTTP/1.1" 200 None
2026-03-24 16:54:31 [ayvens.fr] INFO: Scrape type for 1977536: 2
2026-03-24 16:54:31 [ayvens.fr] INFO: Extracting data for car ID: 1977536
2026-03-24 16:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cac00d8-b9c8-5bfa-8163-d782b05d7d18 with identifier: 1977536
2026-03-24 16:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cac00d8-b9c8-5bfa-8163-d782b05d7d18 with scrape type 2
2026-03-24 16:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cac00d8-b9c8-5bfa-8163-d782b05d7d18 with scrape type 2
2026-03-24 16:54:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1cac00d8-b9c8-5bfa-8163-d782b05d7d18, identifier: 1977536
2026-03-24 16:54:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1cac00d8-b9c8-5bfa-8163-d782b05d7d18 with identifier: 1977536
2026-03-24 16:54:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1cac00d8-b9c8-5bfa-8163-d782b05d7d18 with identifier: 1977536
2026-03-24 16:54:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1cac00d8-b9c8-5bfa-8163-d782b05d7d18 with identifier: 1977536 to the API
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 225,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1cac00d8-b9c8-5bfa-8163-d782b05d7d18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER PROPULSION',
'odometer': 175003,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT MASTER PROPULSION Master CCb R3500RJ L4 2.3 dCi 165ch '
'energy Grand Confort',
'transmission': 'manual',
'trim': 'Master CCb R3500RJ L4 2.3 dCi 165ch energy Grand Confort',
'vin': None,
'year': 2020}
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977536%27 HTTP/1.1" 200 None
2026-03-24 16:54:31 [ayvens.fr] INFO: Saving data for 1977536: {'auction_closing_time': 1774454400.0, 'created_time': 1774284525.556049, 'last_price_update_time': 1774371271.802559}
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977536') HTTP/1.1" 204 0
2026-03-24 16:54:31 [ayvens.fr] INFO: Found listing with ID: 1977537
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977537%27 HTTP/1.1" 200 None
2026-03-24 16:54:31 [ayvens.fr] INFO: Scrape type for 1977537: 2
2026-03-24 16:54:31 [ayvens.fr] INFO: Extracting data for car ID: 1977537
2026-03-24 16:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cbf2b94-31ee-5360-b5fb-048b84ede741 with identifier: 1977537
2026-03-24 16:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cbf2b94-31ee-5360-b5fb-048b84ede741 with scrape type 2
2026-03-24 16:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cbf2b94-31ee-5360-b5fb-048b84ede741 with scrape type 2
2026-03-24 16:54:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3cbf2b94-31ee-5360-b5fb-048b84ede741, identifier: 1977537
2026-03-24 16:54:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3cbf2b94-31ee-5360-b5fb-048b84ede741 with identifier: 1977537
2026-03-24 16:54:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3cbf2b94-31ee-5360-b5fb-048b84ede741 with identifier: 1977537
2026-03-24 16:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3cbf2b94-31ee-5360-b5fb-048b84ede741 with identifier: 1977537 to the API
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3cbf2b94-31ee-5360-b5fb-048b84ede741',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'MONDEO',
'odometer': 155899,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD MONDEO Mondeo SW 2.0 HYBRID 187ch Titanium BVA',
'transmission': 'automatic',
'trim': 'Mondeo SW 2.0 HYBRID 187ch Titanium BVA',
'vin': None,
'year': 2019}
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977537%27 HTTP/1.1" 200 None
2026-03-24 16:54:32 [ayvens.fr] INFO: Saving data for 1977537: {'auction_closing_time': 1774454400.0, 'created_time': 1774284527.185232, 'last_price_update_time': 1774371272.383765}
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977537') HTTP/1.1" 204 0
2026-03-24 16:54:32 [ayvens.fr] INFO: Found listing with ID: 1977538
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977538%27 HTTP/1.1" 200 None
2026-03-24 16:54:32 [ayvens.fr] INFO: Scrape type for 1977538: 2
2026-03-24 16:54:32 [ayvens.fr] INFO: Extracting data for car ID: 1977538
2026-03-24 16:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a902ee41-8ecf-5070-aa21-dd32980e8183 with identifier: 1977538
2026-03-24 16:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a902ee41-8ecf-5070-aa21-dd32980e8183 with scrape type 2
2026-03-24 16:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a902ee41-8ecf-5070-aa21-dd32980e8183 with scrape type 2
2026-03-24 16:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a902ee41-8ecf-5070-aa21-dd32980e8183, identifier: 1977538
2026-03-24 16:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a902ee41-8ecf-5070-aa21-dd32980e8183 with identifier: 1977538
2026-03-24 16:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a902ee41-8ecf-5070-aa21-dd32980e8183 with identifier: 1977538
2026-03-24 16:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a902ee41-8ecf-5070-aa21-dd32980e8183 with identifier: 1977538 to the API
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a902ee41-8ecf-5070-aa21-dd32980e8183',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CONNECT VU',
'odometer': 151834,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-02',
'seats_number': 3,
'seller_name': None,
'title': 'FORD TRANSIT CONNECT VU Transit Connect L1 1.5 TD 100ch Stop&Start '
'Trend Business Nav',
'transmission': 'manual',
'trim': 'Transit Connect L1 1.5 TD 100ch Stop&Start Trend Business Nav',
'vin': None,
'year': 2019}
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977538%27 HTTP/1.1" 200 None
2026-03-24 16:54:32 [ayvens.fr] INFO: Saving data for 1977538: {'auction_closing_time': 1774454400.0, 'created_time': 1774284528.343493, 'last_price_update_time': 1774371272.847789}
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977538') HTTP/1.1" 204 0
2026-03-24 16:54:32 [ayvens.fr] INFO: Found listing with ID: 1977539
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977539%27 HTTP/1.1" 200 None
2026-03-24 16:54:32 [ayvens.fr] INFO: Scrape type for 1977539: 2
2026-03-24 16:54:32 [ayvens.fr] INFO: Extracting data for car ID: 1977539
2026-03-24 16:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af49231-57de-529c-bafa-5bbdcd9c920f with identifier: 1977539
2026-03-24 16:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af49231-57de-529c-bafa-5bbdcd9c920f with scrape type 2
2026-03-24 16:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af49231-57de-529c-bafa-5bbdcd9c920f with scrape type 2
2026-03-24 16:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0af49231-57de-529c-bafa-5bbdcd9c920f, identifier: 1977539
2026-03-24 16:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0af49231-57de-529c-bafa-5bbdcd9c920f with identifier: 1977539
2026-03-24 16:54:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0af49231-57de-529c-bafa-5bbdcd9c920f with identifier: 1977539
2026-03-24 16:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0af49231-57de-529c-bafa-5bbdcd9c920f with identifier: 1977539 to the API
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'ROUGE RUBI NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0af49231-57de-529c-bafa-5bbdcd9c920f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'GRAND C4 SPACETOURER',
'odometer': 206520,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-26',
'seats_number': 7,
'seller_name': None,
'title': 'CITROËN GRAND C4 SPACETOURER Grand C4 SpaceTourer BlueHDi 130ch S&S '
'Business EAT8',
'transmission': 'automatic',
'trim': 'Grand C4 SpaceTourer BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977539%27 HTTP/1.1" 200 None
2026-03-24 16:54:33 [ayvens.fr] INFO: Saving data for 1977539: {'auction_closing_time': 1774454400.0, 'created_time': 1774284529.965572, 'last_price_update_time': 1774371273.432543}
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977539') HTTP/1.1" 204 0
2026-03-24 16:54:33 [ayvens.fr] INFO: Found listing with ID: 1977540
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977540%27 HTTP/1.1" 200 None
2026-03-24 16:54:33 [ayvens.fr] INFO: Scrape type for 1977540: 2
2026-03-24 16:54:33 [ayvens.fr] INFO: Extracting data for car ID: 1977540
2026-03-24 16:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa118b7e-0699-5607-9433-e8a8fef9341c with identifier: 1977540
2026-03-24 16:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa118b7e-0699-5607-9433-e8a8fef9341c with scrape type 2
2026-03-24 16:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa118b7e-0699-5607-9433-e8a8fef9341c with scrape type 2
2026-03-24 16:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aa118b7e-0699-5607-9433-e8a8fef9341c, identifier: 1977540
2026-03-24 16:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aa118b7e-0699-5607-9433-e8a8fef9341c with identifier: 1977540
2026-03-24 16:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aa118b7e-0699-5607-9433-e8a8fef9341c with identifier: 1977540
2026-03-24 16:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aa118b7e-0699-5607-9433-e8a8fef9341c with identifier: 1977540 to the API
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'aa118b7e-0699-5607-9433-e8a8fef9341c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ESPACE',
'odometer': 142237,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-18',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT ESPACE Espace 1.6 dCi 160ch energy Initiale Paris EDC',
'transmission': 'automatic',
'trim': 'Espace 1.6 dCi 160ch energy Initiale Paris EDC',
'vin': None,
'year': 2017}
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977540%27 HTTP/1.1" 200 None
2026-03-24 16:54:33 [ayvens.fr] INFO: Saving data for 1977540: {'auction_closing_time': 1774454400.0, 'created_time': 1774284531.133281, 'last_price_update_time': 1774371273.827612}
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977540') HTTP/1.1" 204 0
2026-03-24 16:54:33 [ayvens.fr] INFO: Found listing with ID: 1977541
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977541%27 HTTP/1.1" 200 None
2026-03-24 16:54:33 [ayvens.fr] INFO: Scrape type for 1977541: 2
2026-03-24 16:54:33 [ayvens.fr] INFO: Extracting data for car ID: 1977541
2026-03-24 16:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68afa239-707d-57df-95fd-5d0910c290c0 with identifier: 1977541
2026-03-24 16:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68afa239-707d-57df-95fd-5d0910c290c0 with scrape type 2
2026-03-24 16:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68afa239-707d-57df-95fd-5d0910c290c0 with scrape type 2
2026-03-24 16:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 68afa239-707d-57df-95fd-5d0910c290c0, identifier: 1977541
2026-03-24 16:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 68afa239-707d-57df-95fd-5d0910c290c0 with identifier: 1977541
2026-03-24 16:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 68afa239-707d-57df-95fd-5d0910c290c0 with identifier: 1977541
2026-03-24 16:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 68afa239-707d-57df-95fd-5d0910c290c0 with identifier: 1977541 to the API
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '68afa239-707d-57df-95fd-5d0910c290c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 160210,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-26',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 2.0 BlueHDi 120ch S&S Premium',
'transmission': 'manual',
'trim': 'Expert Fg Standard 2.0 BlueHDi 120ch S&S Premium',
'vin': None,
'year': 2019}
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977541%27 HTTP/1.1" 200 None
2026-03-24 16:54:34 [ayvens.fr] INFO: Saving data for 1977541: {'auction_closing_time': 1774454400.0, 'created_time': 1774284532.609931, 'last_price_update_time': 1774371274.354972}
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977541') HTTP/1.1" 204 0
2026-03-24 16:54:34 [ayvens.fr] INFO: Found listing with ID: 1977542
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977542%27 HTTP/1.1" 200 None
2026-03-24 16:54:34 [ayvens.fr] INFO: Scrape type for 1977542: 2
2026-03-24 16:54:34 [ayvens.fr] INFO: Extracting data for car ID: 1977542
2026-03-24 16:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3dff1d2-7752-5bbd-a51d-524d47a52728 with identifier: 1977542
2026-03-24 16:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3dff1d2-7752-5bbd-a51d-524d47a52728 with scrape type 2
2026-03-24 16:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3dff1d2-7752-5bbd-a51d-524d47a52728 with scrape type 2
2026-03-24 16:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a3dff1d2-7752-5bbd-a51d-524d47a52728, identifier: 1977542
2026-03-24 16:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a3dff1d2-7752-5bbd-a51d-524d47a52728 with identifier: 1977542
2026-03-24 16:54:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a3dff1d2-7752-5bbd-a51d-524d47a52728 with identifier: 1977542
2026-03-24 16:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a3dff1d2-7752-5bbd-a51d-524d47a52728 with identifier: 1977542 to the API
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'BLANC CANDY',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a3dff1d2-7752-5bbd-a51d-524d47a52728',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TRANSPORTER',
'odometer': 198671,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seats_number': 3,
'seller_name': None,
'title': 'VOLKSWAGEN TRANSPORTER Transporter Fg 2.8T L1H1 2.0 TDI 110ch '
'Business Line',
'transmission': 'manual',
'trim': 'Transporter Fg 2.8T L1H1 2.0 TDI 110ch Business Line',
'vin': None,
'year': 2019}
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977542%27 HTTP/1.1" 200 None
2026-03-24 16:54:34 [ayvens.fr] INFO: Saving data for 1977542: {'auction_closing_time': 1774454400.0, 'created_time': 1774284534.135596, 'last_price_update_time': 1774371274.752994}
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977542') HTTP/1.1" 204 0
2026-03-24 16:54:34 [ayvens.fr] INFO: Found listing with ID: 1977543
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977543%27 HTTP/1.1" 200 None
2026-03-24 16:54:34 [ayvens.fr] INFO: Scrape type for 1977543: 2
2026-03-24 16:54:34 [ayvens.fr] INFO: Extracting data for car ID: 1977543
2026-03-24 16:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82fb1ae2-53c8-5849-858d-969bad17b118 with identifier: 1977543
2026-03-24 16:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fb1ae2-53c8-5849-858d-969bad17b118 with scrape type 2
2026-03-24 16:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82fb1ae2-53c8-5849-858d-969bad17b118 with scrape type 2
2026-03-24 16:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 82fb1ae2-53c8-5849-858d-969bad17b118, identifier: 1977543
2026-03-24 16:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 82fb1ae2-53c8-5849-858d-969bad17b118 with identifier: 1977543
2026-03-24 16:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 82fb1ae2-53c8-5849-858d-969bad17b118 with identifier: 1977543
2026-03-24 16:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 82fb1ae2-53c8-5849-858d-969bad17b118 with identifier: 1977543 to the API
2026-03-24 16:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '82fb1ae2-53c8-5849-858d-969bad17b118',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'TRANSIT CONNECT VU',
'odometer': 151657,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-28',
'seats_number': 2,
'seller_name': None,
'title': 'FORD TRANSIT CONNECT VU Transit Connect L2 1.5 EcoBlue 100ch Trend '
'Business Nav',
'transmission': 'manual',
'trim': 'Transit Connect L2 1.5 EcoBlue 100ch Trend Business Nav',
'vin': None,
'year': 2020}
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977543%27 HTTP/1.1" 200 None
2026-03-24 16:54:35 [ayvens.fr] INFO: Saving data for 1977543: {'auction_closing_time': 1774454400.0, 'created_time': 1774284535.076642, 'last_price_update_time': 1774371275.147068}
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977543') HTTP/1.1" 204 0
2026-03-24 16:54:35 [ayvens.fr] INFO: Found listing with ID: 1977544
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977544%27 HTTP/1.1" 200 None
2026-03-24 16:54:35 [ayvens.fr] INFO: Scrape type for 1977544: 2
2026-03-24 16:54:35 [ayvens.fr] INFO: Extracting data for car ID: 1977544
2026-03-24 16:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a062c87-4427-512a-bfea-eaece79e1efb with identifier: 1977544
2026-03-24 16:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a062c87-4427-512a-bfea-eaece79e1efb with scrape type 2
2026-03-24 16:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a062c87-4427-512a-bfea-eaece79e1efb with scrape type 2
2026-03-24 16:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1a062c87-4427-512a-bfea-eaece79e1efb, identifier: 1977544
2026-03-24 16:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1a062c87-4427-512a-bfea-eaece79e1efb with identifier: 1977544
2026-03-24 16:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1a062c87-4427-512a-bfea-eaece79e1efb with identifier: 1977544
2026-03-24 16:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1a062c87-4427-512a-bfea-eaece79e1efb with identifier: 1977544 to the API
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1a062c87-4427-512a-bfea-eaece79e1efb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 164790,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-15',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Grand '
'Confort',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Grand Confort',
'vin': None,
'year': 2021}
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977544%27 HTTP/1.1" 200 None
2026-03-24 16:54:35 [ayvens.fr] INFO: Saving data for 1977544: {'auction_closing_time': 1774454400.0, 'created_time': 1774284536.344654, 'last_price_update_time': 1774371275.516896}
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977544') HTTP/1.1" 204 0
2026-03-24 16:54:35 [ayvens.fr] INFO: Found listing with ID: 1977545
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977545%27 HTTP/1.1" 200 None
2026-03-24 16:54:35 [ayvens.fr] INFO: Scrape type for 1977545: 2
2026-03-24 16:54:35 [ayvens.fr] INFO: Extracting data for car ID: 1977545
2026-03-24 16:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30d34143-4756-5875-92fd-f6abb2382a4f with identifier: 1977545
2026-03-24 16:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d34143-4756-5875-92fd-f6abb2382a4f with scrape type 2
2026-03-24 16:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30d34143-4756-5875-92fd-f6abb2382a4f with scrape type 2
2026-03-24 16:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 30d34143-4756-5875-92fd-f6abb2382a4f, identifier: 1977545
2026-03-24 16:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 30d34143-4756-5875-92fd-f6abb2382a4f with identifier: 1977545
2026-03-24 16:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 30d34143-4756-5875-92fd-f6abb2382a4f with identifier: 1977545
2026-03-24 16:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 30d34143-4756-5875-92fd-f6abb2382a4f with identifier: 1977545 to the API
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '30d34143-4756-5875-92fd-f6abb2382a4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 170611,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-10',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Grand '
'Confort',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Grand Confort',
'vin': None,
'year': 2020}
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977545%27 HTTP/1.1" 200 None
2026-03-24 16:54:35 [ayvens.fr] INFO: Saving data for 1977545: {'auction_closing_time': 1774454400.0, 'created_time': 1774284537.810329, 'last_price_update_time': 1774371275.87574}
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977545') HTTP/1.1" 204 0
2026-03-24 16:54:35 [ayvens.fr] INFO: Found listing with ID: 1977546
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977546%27 HTTP/1.1" 200 None
2026-03-24 16:54:35 [ayvens.fr] INFO: Scrape type for 1977546: 2
2026-03-24 16:54:35 [ayvens.fr] INFO: Extracting data for car ID: 1977546
2026-03-24 16:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cec17127-42b3-503b-8714-5c59829e039f with identifier: 1977546
2026-03-24 16:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cec17127-42b3-503b-8714-5c59829e039f with scrape type 2
2026-03-24 16:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cec17127-42b3-503b-8714-5c59829e039f with scrape type 2
2026-03-24 16:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cec17127-42b3-503b-8714-5c59829e039f, identifier: 1977546
2026-03-24 16:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cec17127-42b3-503b-8714-5c59829e039f with identifier: 1977546
2026-03-24 16:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cec17127-42b3-503b-8714-5c59829e039f with identifier: 1977546
2026-03-24 16:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cec17127-42b3-503b-8714-5c59829e039f with identifier: 1977546 to the API
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 190,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'cec17127-42b3-503b-8714-5c59829e039f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 173944,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L1H1 1000 2.0 dCi 120ch Grand Confort',
'transmission': 'manual',
'trim': 'Trafic Fg L1H1 1000 2.0 dCi 120ch Grand Confort',
'vin': None,
'year': 2020}
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977546%27 HTTP/1.1" 200 None
2026-03-24 16:54:36 [ayvens.fr] INFO: Saving data for 1977546: {'auction_closing_time': 1774454400.0, 'created_time': 1774284539.042918, 'last_price_update_time': 1774371276.261636}
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977546') HTTP/1.1" 204 0
2026-03-24 16:54:36 [ayvens.fr] INFO: Found listing with ID: 1977547
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977547%27 HTTP/1.1" 200 None
2026-03-24 16:54:36 [ayvens.fr] INFO: Scrape type for 1977547: 2
2026-03-24 16:54:36 [ayvens.fr] INFO: Extracting data for car ID: 1977547
2026-03-24 16:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4549dd19-d213-5306-b8d0-e56abce7b92d with identifier: 1977547
2026-03-24 16:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4549dd19-d213-5306-b8d0-e56abce7b92d with scrape type 2
2026-03-24 16:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4549dd19-d213-5306-b8d0-e56abce7b92d with scrape type 2
2026-03-24 16:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4549dd19-d213-5306-b8d0-e56abce7b92d, identifier: 1977547
2026-03-24 16:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4549dd19-d213-5306-b8d0-e56abce7b92d with identifier: 1977547
2026-03-24 16:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4549dd19-d213-5306-b8d0-e56abce7b92d with identifier: 1977547
2026-03-24 16:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4549dd19-d213-5306-b8d0-e56abce7b92d with identifier: 1977547 to the API
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '4549dd19-d213-5306-b8d0-e56abce7b92d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 165603,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-07',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 1000kg BlueHDi 100 S&S Worker BMV5',
'transmission': 'manual',
'trim': 'Berlingo Van M 1000kg BlueHDi 100 S&S Worker BMV5',
'vin': None,
'year': 2020}
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977547%27 HTTP/1.1" 200 None
2026-03-24 16:54:36 [ayvens.fr] INFO: Saving data for 1977547: {'auction_closing_time': 1774454400.0, 'created_time': 1774284540.961632, 'last_price_update_time': 1774371276.704443}
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977547') HTTP/1.1" 204 0
2026-03-24 16:54:36 [ayvens.fr] INFO: Found listing with ID: 1977548
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977548%27 HTTP/1.1" 200 None
2026-03-24 16:54:36 [ayvens.fr] INFO: Scrape type for 1977548: 2
2026-03-24 16:54:36 [ayvens.fr] INFO: Extracting data for car ID: 1977548
2026-03-24 16:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339 with identifier: 1977548
2026-03-24 16:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339 with scrape type 2
2026-03-24 16:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339 with scrape type 2
2026-03-24 16:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339, identifier: 1977548
2026-03-24 16:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339 with identifier: 1977548
2026-03-24 16:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339 with identifier: 1977548
2026-03-24 16:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339 with identifier: 1977548 to the API
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '95f6e9e2-58a5-5b0b-b0fc-fb7b022c1339',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 202885,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-11',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2022}
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977548%27 HTTP/1.1" 200 None
2026-03-24 16:54:37 [ayvens.fr] INFO: Saving data for 1977548: {'auction_closing_time': 1774454400.0, 'created_time': 1774284543.000188, 'last_price_update_time': 1774371277.076034}
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977548') HTTP/1.1" 204 0
2026-03-24 16:54:37 [ayvens.fr] INFO: Found listing with ID: 1977549
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977549%27 HTTP/1.1" 200 None
2026-03-24 16:54:37 [ayvens.fr] INFO: Scrape type for 1977549: 2
2026-03-24 16:54:37 [ayvens.fr] INFO: Extracting data for car ID: 1977549
2026-03-24 16:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1b9546a-f638-50ac-bf5e-686c131b4013 with identifier: 1977549
2026-03-24 16:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b9546a-f638-50ac-bf5e-686c131b4013 with scrape type 2
2026-03-24 16:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1b9546a-f638-50ac-bf5e-686c131b4013 with scrape type 2
2026-03-24 16:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a1b9546a-f638-50ac-bf5e-686c131b4013, identifier: 1977549
2026-03-24 16:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a1b9546a-f638-50ac-bf5e-686c131b4013 with identifier: 1977549
2026-03-24 16:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a1b9546a-f638-50ac-bf5e-686c131b4013 with identifier: 1977549
2026-03-24 16:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a1b9546a-f638-50ac-bf5e-686c131b4013 with identifier: 1977549 to the API
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 194,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a1b9546a-f638-50ac-bf5e-686c131b4013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 168503,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-24',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3500 L1H2 2.3 dCi 110ch Stop&Start Grand '
'Confort',
'transmission': 'manual',
'trim': 'Master Fg F3500 L1H2 2.3 dCi 110ch Stop&Start Grand Confort',
'vin': None,
'year': 2017}
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977549%27 HTTP/1.1" 200 None
2026-03-24 16:54:37 [ayvens.fr] INFO: Saving data for 1977549: {'auction_closing_time': 1774454400.0, 'created_time': 1774284545.021202, 'last_price_update_time': 1774371277.465598}
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977549') HTTP/1.1" 204 0
2026-03-24 16:54:37 [ayvens.fr] INFO: Found listing with ID: 1977550
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977550%27 HTTP/1.1" 200 None
2026-03-24 16:54:37 [ayvens.fr] INFO: Scrape type for 1977550: 2
2026-03-24 16:54:37 [ayvens.fr] INFO: Extracting data for car ID: 1977550
2026-03-24 16:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0557bf3e-266b-5d91-8861-01df33df6337 with identifier: 1977550
2026-03-24 16:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0557bf3e-266b-5d91-8861-01df33df6337 with scrape type 2
2026-03-24 16:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0557bf3e-266b-5d91-8861-01df33df6337 with scrape type 2
2026-03-24 16:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0557bf3e-266b-5d91-8861-01df33df6337, identifier: 1977550
2026-03-24 16:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0557bf3e-266b-5d91-8861-01df33df6337 with identifier: 1977550
2026-03-24 16:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0557bf3e-266b-5d91-8861-01df33df6337 with identifier: 1977550
2026-03-24 16:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0557bf3e-266b-5d91-8861-01df33df6337 with identifier: 1977550 to the API
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0557bf3e-266b-5d91-8861-01df33df6337',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'BOXER',
'odometer': 160380,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-22',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT BOXER Boxer Fg 335 L2H2 2.0 BlueHDi 130 S&S Premium',
'transmission': 'manual',
'trim': 'Boxer Fg 335 L2H2 2.0 BlueHDi 130 S&S Premium',
'vin': None,
'year': 2019}
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977550%27 HTTP/1.1" 200 None
2026-03-24 16:54:37 [ayvens.fr] INFO: Saving data for 1977550: {'auction_closing_time': 1774454400.0, 'created_time': 1774284546.360265, 'last_price_update_time': 1774371277.819576}
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977550') HTTP/1.1" 204 0
2026-03-24 16:54:37 [ayvens.fr] INFO: Found listing with ID: 1977551
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977551%27 HTTP/1.1" 200 None
2026-03-24 16:54:37 [ayvens.fr] INFO: Scrape type for 1977551: 2
2026-03-24 16:54:37 [ayvens.fr] INFO: Extracting data for car ID: 1977551
2026-03-24 16:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0018d8d-5bdb-585e-850e-6bf8a88582bb with identifier: 1977551
2026-03-24 16:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0018d8d-5bdb-585e-850e-6bf8a88582bb with scrape type 2
2026-03-24 16:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0018d8d-5bdb-585e-850e-6bf8a88582bb with scrape type 2
2026-03-24 16:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c0018d8d-5bdb-585e-850e-6bf8a88582bb, identifier: 1977551
2026-03-24 16:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c0018d8d-5bdb-585e-850e-6bf8a88582bb with identifier: 1977551
2026-03-24 16:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c0018d8d-5bdb-585e-850e-6bf8a88582bb with identifier: 1977551
2026-03-24 16:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c0018d8d-5bdb-585e-850e-6bf8a88582bb with identifier: 1977551 to the API
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c0018d8d-5bdb-585e-850e-6bf8a88582bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 156711,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-13',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 95ch Grand '
'Confort',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 95ch Grand Confort',
'vin': None,
'year': 2019}
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977551%27 HTTP/1.1" 200 None
2026-03-24 16:54:38 [ayvens.fr] INFO: Saving data for 1977551: {'auction_closing_time': 1774454400.0, 'created_time': 1774284547.377514, 'last_price_update_time': 1774371278.247958}
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977551') HTTP/1.1" 204 0
2026-03-24 16:54:38 [ayvens.fr] INFO: Found listing with ID: 1977552
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977552%27 HTTP/1.1" 200 None
2026-03-24 16:54:38 [ayvens.fr] INFO: Scrape type for 1977552: 2
2026-03-24 16:54:38 [ayvens.fr] INFO: Extracting data for car ID: 1977552
2026-03-24 16:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 207965d7-fa66-57f6-b0a1-0cf434e3a98d with identifier: 1977552
2026-03-24 16:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 207965d7-fa66-57f6-b0a1-0cf434e3a98d with scrape type 2
2026-03-24 16:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 207965d7-fa66-57f6-b0a1-0cf434e3a98d with scrape type 2
2026-03-24 16:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 207965d7-fa66-57f6-b0a1-0cf434e3a98d, identifier: 1977552
2026-03-24 16:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 207965d7-fa66-57f6-b0a1-0cf434e3a98d with identifier: 1977552
2026-03-24 16:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 207965d7-fa66-57f6-b0a1-0cf434e3a98d with identifier: 1977552
2026-03-24 16:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 207965d7-fa66-57f6-b0a1-0cf434e3a98d with identifier: 1977552 to the API
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '207965d7-fa66-57f6-b0a1-0cf434e3a98d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 159718,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-08',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio St 1.5 Blue dCi 85ch Air Nav',
'transmission': 'manual',
'trim': 'Clio St 1.5 Blue dCi 85ch Air Nav',
'vin': None,
'year': 2021}
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977552%27 HTTP/1.1" 200 None
2026-03-24 16:54:38 [ayvens.fr] INFO: Saving data for 1977552: {'auction_closing_time': 1774454400.0, 'created_time': 1774284549.157375, 'last_price_update_time': 1774371278.617455}
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977552') HTTP/1.1" 204 0
2026-03-24 16:54:38 [ayvens.fr] INFO: Found listing with ID: 1977553
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977553%27 HTTP/1.1" 200 None
2026-03-24 16:54:38 [ayvens.fr] INFO: Scrape type for 1977553: 2
2026-03-24 16:54:38 [ayvens.fr] INFO: Extracting data for car ID: 1977553
2026-03-24 16:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c09d61-2007-583f-8443-6447c5fc9851 with identifier: 1977553
2026-03-24 16:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c09d61-2007-583f-8443-6447c5fc9851 with scrape type 2
2026-03-24 16:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3c09d61-2007-583f-8443-6447c5fc9851 with scrape type 2
2026-03-24 16:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c3c09d61-2007-583f-8443-6447c5fc9851, identifier: 1977553
2026-03-24 16:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c3c09d61-2007-583f-8443-6447c5fc9851 with identifier: 1977553
2026-03-24 16:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c3c09d61-2007-583f-8443-6447c5fc9851 with identifier: 1977553
2026-03-24 16:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c3c09d61-2007-583f-8443-6447c5fc9851 with identifier: 1977553 to the API
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c3c09d61-2007-583f-8443-6447c5fc9851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 153722,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-13',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 130 S&S Driver',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 130 S&S Driver',
'vin': None,
'year': 2019}
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977553%27 HTTP/1.1" 200 None
2026-03-24 16:54:38 [ayvens.fr] INFO: Saving data for 1977553: {'auction_closing_time': 1774454400.0, 'created_time': 1774284550.596154, 'last_price_update_time': 1774371278.990822}
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977553') HTTP/1.1" 204 0
2026-03-24 16:54:39 [ayvens.fr] INFO: Found listing with ID: 1977554
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977554%27 HTTP/1.1" 200 None
2026-03-24 16:54:39 [ayvens.fr] INFO: Scrape type for 1977554: 2
2026-03-24 16:54:39 [ayvens.fr] INFO: Extracting data for car ID: 1977554
2026-03-24 16:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df26759-37a3-5538-b934-9cc3dff17251 with identifier: 1977554
2026-03-24 16:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df26759-37a3-5538-b934-9cc3dff17251 with scrape type 2
2026-03-24 16:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1df26759-37a3-5538-b934-9cc3dff17251 with scrape type 2
2026-03-24 16:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1df26759-37a3-5538-b934-9cc3dff17251, identifier: 1977554
2026-03-24 16:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1df26759-37a3-5538-b934-9cc3dff17251 with identifier: 1977554
2026-03-24 16:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1df26759-37a3-5538-b934-9cc3dff17251 with identifier: 1977554
2026-03-24 16:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1df26759-37a3-5538-b934-9cc3dff17251 with identifier: 1977554 to the API
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '1df26759-37a3-5538-b934-9cc3dff17251',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 151175,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-16',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'vin': None,
'year': 2020}
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977554%27 HTTP/1.1" 200 None
2026-03-24 16:54:39 [ayvens.fr] INFO: Saving data for 1977554: {'auction_closing_time': 1774454400.0, 'created_time': 1774284551.779595, 'last_price_update_time': 1774371279.391992}
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977554') HTTP/1.1" 204 0
2026-03-24 16:54:39 [ayvens.fr] INFO: Found listing with ID: 1977555
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977555%27 HTTP/1.1" 200 None
2026-03-24 16:54:39 [ayvens.fr] INFO: Scrape type for 1977555: 2
2026-03-24 16:54:39 [ayvens.fr] INFO: Extracting data for car ID: 1977555
2026-03-24 16:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601 with identifier: 1977555
2026-03-24 16:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601 with scrape type 2
2026-03-24 16:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601 with scrape type 2
2026-03-24 16:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601, identifier: 1977555
2026-03-24 16:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601 with identifier: 1977555
2026-03-24 16:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601 with identifier: 1977555
2026-03-24 16:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601 with identifier: 1977555 to the API
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '2dbfe9bf-9f2a-508a-b3b6-ed3b5e043601',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 201913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-31',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Ste 1.5 Blue dCi 115ch energy Air Nav',
'transmission': 'manual',
'trim': 'Megane Ste 1.5 Blue dCi 115ch energy Air Nav',
'vin': None,
'year': 2019}
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977555%27 HTTP/1.1" 200 None
2026-03-24 16:54:39 [ayvens.fr] INFO: Saving data for 1977555: {'auction_closing_time': 1774454400.0, 'created_time': 1774284553.220314, 'last_price_update_time': 1774371279.805281}
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977555') HTTP/1.1" 204 0
2026-03-24 16:54:39 [ayvens.fr] INFO: Found listing with ID: 1977556
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977556%27 HTTP/1.1" 200 None
2026-03-24 16:54:39 [ayvens.fr] INFO: Scrape type for 1977556: 2
2026-03-24 16:54:39 [ayvens.fr] INFO: Extracting data for car ID: 1977556
2026-03-24 16:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe60b3b-8442-5ec3-9276-9465df568e12 with identifier: 1977556
2026-03-24 16:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe60b3b-8442-5ec3-9276-9465df568e12 with scrape type 2
2026-03-24 16:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abe60b3b-8442-5ec3-9276-9465df568e12 with scrape type 2
2026-03-24 16:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: abe60b3b-8442-5ec3-9276-9465df568e12, identifier: 1977556
2026-03-24 16:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: abe60b3b-8442-5ec3-9276-9465df568e12 with identifier: 1977556
2026-03-24 16:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: abe60b3b-8442-5ec3-9276-9465df568e12 with identifier: 1977556
2026-03-24 16:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: abe60b3b-8442-5ec3-9276-9465df568e12 with identifier: 1977556 to the API
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 190,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'abe60b3b-8442-5ec3-9276-9465df568e12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 168917,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-09',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 2.0 BlueHDi 120ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 2.0 BlueHDi 120ch S&S Club',
'vin': None,
'year': 2020}
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977556%27 HTTP/1.1" 200 None
2026-03-24 16:54:40 [ayvens.fr] INFO: Saving data for 1977556: {'auction_closing_time': 1774454400.0, 'created_time': 1774284554.70477, 'last_price_update_time': 1774371280.550932}
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977556') HTTP/1.1" 204 0
2026-03-24 16:54:40 [ayvens.fr] INFO: Found listing with ID: 1977557
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977557%27 HTTP/1.1" 200 None
2026-03-24 16:54:40 [ayvens.fr] INFO: Scrape type for 1977557: 2
2026-03-24 16:54:40 [ayvens.fr] INFO: Extracting data for car ID: 1977557
2026-03-24 16:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6380121-c5f9-55eb-a07a-800aebe9cb91 with identifier: 1977557
2026-03-24 16:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6380121-c5f9-55eb-a07a-800aebe9cb91 with scrape type 2
2026-03-24 16:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6380121-c5f9-55eb-a07a-800aebe9cb91 with scrape type 2
2026-03-24 16:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b6380121-c5f9-55eb-a07a-800aebe9cb91, identifier: 1977557
2026-03-24 16:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b6380121-c5f9-55eb-a07a-800aebe9cb91 with identifier: 1977557
2026-03-24 16:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b6380121-c5f9-55eb-a07a-800aebe9cb91 with identifier: 1977557
2026-03-24 16:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b6380121-c5f9-55eb-a07a-800aebe9cb91 with identifier: 1977557 to the API
2026-03-24 16:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b6380121-c5f9-55eb-a07a-800aebe9cb91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 168394,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-06',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Ste 1.5 dCi 75ch energy Air MediaNav',
'transmission': 'manual',
'trim': 'Clio Ste 1.5 dCi 75ch energy Air MediaNav',
'vin': None,
'year': 2018}
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977557%27 HTTP/1.1" 200 None
2026-03-24 16:54:41 [ayvens.fr] INFO: Saving data for 1977557: {'auction_closing_time': 1774454400.0, 'created_time': 1774284555.731432, 'last_price_update_time': 1774371281.275592}
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977557') HTTP/1.1" 204 0
2026-03-24 16:54:41 [ayvens.fr] INFO: Found listing with ID: 1977558
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977558%27 HTTP/1.1" 200 None
2026-03-24 16:54:41 [ayvens.fr] INFO: Scrape type for 1977558: 2
2026-03-24 16:54:41 [ayvens.fr] INFO: Extracting data for car ID: 1977558
2026-03-24 16:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9 with identifier: 1977558
2026-03-24 16:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9 with scrape type 2
2026-03-24 16:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9 with scrape type 2
2026-03-24 16:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9, identifier: 1977558
2026-03-24 16:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9 with identifier: 1977558
2026-03-24 16:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9 with identifier: 1977558
2026-03-24 16:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0e72fd64-fdf5-5770-a1b8-f036c9bdccd9 with identifier: 1977558 to the API
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 225,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '0e72fd64-fdf5-5770-a1b8-f036c9bdccd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER PROPULSION',
'odometer': 163891,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-22',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER PROPULSION Master Fg R3500RJ L3H2 2.3 dCi 165ch '
'energy Grand Confort',
'transmission': 'manual',
'trim': 'Master Fg R3500RJ L3H2 2.3 dCi 165ch energy Grand Confort',
'vin': None,
'year': 2021}
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977558%27 HTTP/1.1" 200 None
2026-03-24 16:54:41 [ayvens.fr] INFO: Saving data for 1977558: {'auction_closing_time': 1774454400.0, 'created_time': 1774284557.589529, 'last_price_update_time': 1774371281.838331}
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977558') HTTP/1.1" 204 0
2026-03-24 16:54:41 [ayvens.fr] INFO: Found listing with ID: 1977559
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977559%27 HTTP/1.1" 200 None
2026-03-24 16:54:41 [ayvens.fr] INFO: Scrape type for 1977559: 2
2026-03-24 16:54:41 [ayvens.fr] INFO: Extracting data for car ID: 1977559
2026-03-24 16:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f02dc9-ad07-5804-9c19-8534ca5dbbbd with identifier: 1977559
2026-03-24 16:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f02dc9-ad07-5804-9c19-8534ca5dbbbd with scrape type 2
2026-03-24 16:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14f02dc9-ad07-5804-9c19-8534ca5dbbbd with scrape type 2
2026-03-24 16:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 14f02dc9-ad07-5804-9c19-8534ca5dbbbd, identifier: 1977559
2026-03-24 16:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 14f02dc9-ad07-5804-9c19-8534ca5dbbbd with identifier: 1977559
2026-03-24 16:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 14f02dc9-ad07-5804-9c19-8534ca5dbbbd with identifier: 1977559
2026-03-24 16:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 14f02dc9-ad07-5804-9c19-8534ca5dbbbd with identifier: 1977559 to the API
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '14f02dc9-ad07-5804-9c19-8534ca5dbbbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'IVECO',
'model': 'DAILY',
'odometer': 183940,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-01',
'seats_number': 3,
'seller_name': None,
'title': 'IVECO DAILY Daily 35C Fg 35C14V12 Tor',
'transmission': 'manual',
'trim': 'Daily 35C Fg 35C14V12 Tor',
'vin': None,
'year': 2018}
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977559%27 HTTP/1.1" 200 None
2026-03-24 16:54:42 [ayvens.fr] INFO: Saving data for 1977559: {'auction_closing_time': 1774454400.0, 'created_time': 1774284559.04611, 'last_price_update_time': 1774371282.299964}
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977559') HTTP/1.1" 204 0
2026-03-24 16:54:42 [ayvens.fr] INFO: Found listing with ID: 1977560
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977560%27 HTTP/1.1" 200 None
2026-03-24 16:54:42 [ayvens.fr] INFO: Scrape type for 1977560: 2
2026-03-24 16:54:42 [ayvens.fr] INFO: Extracting data for car ID: 1977560
2026-03-24 16:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8292eac5-5d0e-5a31-b81c-cffa669e01c6 with identifier: 1977560
2026-03-24 16:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8292eac5-5d0e-5a31-b81c-cffa669e01c6 with scrape type 2
2026-03-24 16:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8292eac5-5d0e-5a31-b81c-cffa669e01c6 with scrape type 2
2026-03-24 16:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8292eac5-5d0e-5a31-b81c-cffa669e01c6, identifier: 1977560
2026-03-24 16:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8292eac5-5d0e-5a31-b81c-cffa669e01c6 with identifier: 1977560
2026-03-24 16:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8292eac5-5d0e-5a31-b81c-cffa669e01c6 with identifier: 1977560
2026-03-24 16:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8292eac5-5d0e-5a31-b81c-cffa669e01c6 with identifier: 1977560 to the API
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '8292eac5-5d0e-5a31-b81c-cffa669e01c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 151138,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-30',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Club BVM5',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Club BVM5',
'vin': None,
'year': 2019}
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977560%27 HTTP/1.1" 200 None
2026-03-24 16:54:42 [ayvens.fr] INFO: Saving data for 1977560: {'auction_closing_time': 1774454400.0, 'created_time': 1774284560.008635, 'last_price_update_time': 1774371282.723782}
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977560') HTTP/1.1" 204 0
2026-03-24 16:54:42 [ayvens.fr] INFO: Found listing with ID: 1977561
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977561%27 HTTP/1.1" 200 None
2026-03-24 16:54:42 [ayvens.fr] INFO: Scrape type for 1977561: 2
2026-03-24 16:54:42 [ayvens.fr] INFO: Extracting data for car ID: 1977561
2026-03-24 16:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46271e3-d9c1-5ccf-89a1-15078bba3caf with identifier: 1977561
2026-03-24 16:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46271e3-d9c1-5ccf-89a1-15078bba3caf with scrape type 2
2026-03-24 16:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46271e3-d9c1-5ccf-89a1-15078bba3caf with scrape type 2
2026-03-24 16:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a46271e3-d9c1-5ccf-89a1-15078bba3caf, identifier: 1977561
2026-03-24 16:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a46271e3-d9c1-5ccf-89a1-15078bba3caf with identifier: 1977561
2026-03-24 16:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a46271e3-d9c1-5ccf-89a1-15078bba3caf with identifier: 1977561
2026-03-24 16:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a46271e3-d9c1-5ccf-89a1-15078bba3caf with identifier: 1977561 to the API
2026-03-24 16:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 173,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a46271e3-d9c1-5ccf-89a1-15078bba3caf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TRANSPORTER',
'odometer': 165356,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-10',
'seats_number': 3,
'seller_name': None,
'title': 'VOLKSWAGEN TRANSPORTER Transporter Fg 2.8T L1H1 2.0 TDI 150ch '
'Business Line 4Motion',
'transmission': 'manual',
'trim': 'Transporter Fg 2.8T L1H1 2.0 TDI 150ch Business Line 4Motion',
'vin': None,
'year': 2019}
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977561%27 HTTP/1.1" 200 None
2026-03-24 16:54:43 [ayvens.fr] INFO: Saving data for 1977561: {'auction_closing_time': 1774454400.0, 'created_time': 1774284561.43738, 'last_price_update_time': 1774371283.121983}
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977561') HTTP/1.1" 204 0
2026-03-24 16:54:43 [ayvens.fr] INFO: Found listing with ID: 1977562
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977562%27 HTTP/1.1" 200 None
2026-03-24 16:54:43 [ayvens.fr] INFO: Scrape type for 1977562: 2
2026-03-24 16:54:43 [ayvens.fr] INFO: Extracting data for car ID: 1977562
2026-03-24 16:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81112f63-005a-5f3e-97b6-127669c6a978 with identifier: 1977562
2026-03-24 16:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81112f63-005a-5f3e-97b6-127669c6a978 with scrape type 2
2026-03-24 16:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81112f63-005a-5f3e-97b6-127669c6a978 with scrape type 2
2026-03-24 16:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 81112f63-005a-5f3e-97b6-127669c6a978, identifier: 1977562
2026-03-24 16:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 81112f63-005a-5f3e-97b6-127669c6a978 with identifier: 1977562
2026-03-24 16:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 81112f63-005a-5f3e-97b6-127669c6a978 with identifier: 1977562
2026-03-24 16:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 81112f63-005a-5f3e-97b6-127669c6a978 with identifier: 1977562 to the API
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '81112f63-005a-5f3e-97b6-127669c6a978',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 152434,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Ste 1.5 Blue dCi 85ch Air',
'transmission': 'manual',
'trim': 'Clio Ste 1.5 Blue dCi 85ch Air',
'vin': None,
'year': 2020}
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977562%27 HTTP/1.1" 200 None
2026-03-24 16:54:43 [ayvens.fr] INFO: Saving data for 1977562: {'auction_closing_time': 1774454400.0, 'created_time': 1774284562.722479, 'last_price_update_time': 1774371283.494919}
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977562') HTTP/1.1" 204 0
2026-03-24 16:54:43 [ayvens.fr] INFO: Found listing with ID: 1977563
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977563%27 HTTP/1.1" 200 None
2026-03-24 16:54:43 [ayvens.fr] INFO: Scrape type for 1977563: 2
2026-03-24 16:54:43 [ayvens.fr] INFO: Extracting data for car ID: 1977563
2026-03-24 16:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a43c5ce7-c322-5dc8-ae67-613ec60d8d72 with identifier: 1977563
2026-03-24 16:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43c5ce7-c322-5dc8-ae67-613ec60d8d72 with scrape type 2
2026-03-24 16:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a43c5ce7-c322-5dc8-ae67-613ec60d8d72 with scrape type 2
2026-03-24 16:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a43c5ce7-c322-5dc8-ae67-613ec60d8d72, identifier: 1977563
2026-03-24 16:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a43c5ce7-c322-5dc8-ae67-613ec60d8d72 with identifier: 1977563
2026-03-24 16:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a43c5ce7-c322-5dc8-ae67-613ec60d8d72 with identifier: 1977563
2026-03-24 16:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a43c5ce7-c322-5dc8-ae67-613ec60d8d72 with identifier: 1977563 to the API
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a43c5ce7-c322-5dc8-ae67-613ec60d8d72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 166511,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-09',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg XL 2.0 BlueHDi 120ch S&S Driver',
'transmission': 'manual',
'trim': 'Jumpy Fg XL 2.0 BlueHDi 120ch S&S Driver',
'vin': None,
'year': 2022}
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977563%27 HTTP/1.1" 200 None
2026-03-24 16:54:43 [ayvens.fr] INFO: Saving data for 1977563: {'auction_closing_time': 1774454400.0, 'created_time': 1774284563.92938, 'last_price_update_time': 1774371283.860049}
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977563') HTTP/1.1" 204 0
2026-03-24 16:54:43 [ayvens.fr] INFO: Found listing with ID: 1977564
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977564%27 HTTP/1.1" 200 None
2026-03-24 16:54:43 [ayvens.fr] INFO: Scrape type for 1977564: 2
2026-03-24 16:54:43 [ayvens.fr] INFO: Extracting data for car ID: 1977564
2026-03-24 16:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a840e3aa-57c8-5b06-bfd3-f54b0e53a329 with identifier: 1977564
2026-03-24 16:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a840e3aa-57c8-5b06-bfd3-f54b0e53a329 with scrape type 2
2026-03-24 16:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a840e3aa-57c8-5b06-bfd3-f54b0e53a329 with scrape type 2
2026-03-24 16:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a840e3aa-57c8-5b06-bfd3-f54b0e53a329, identifier: 1977564
2026-03-24 16:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a840e3aa-57c8-5b06-bfd3-f54b0e53a329 with identifier: 1977564
2026-03-24 16:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a840e3aa-57c8-5b06-bfd3-f54b0e53a329 with identifier: 1977564
2026-03-24 16:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a840e3aa-57c8-5b06-bfd3-f54b0e53a329 with identifier: 1977564 to the API
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 157,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a840e3aa-57c8-5b06-bfd3-f54b0e53a329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 160182,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-14',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 130 S&S Driver EAT8',
'transmission': 'automatic',
'trim': 'Berlingo Van M 650kg BlueHDi 130 S&S Driver EAT8',
'vin': None,
'year': 2020}
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977564%27 HTTP/1.1" 200 None
2026-03-24 16:54:44 [ayvens.fr] INFO: Saving data for 1977564: {'auction_closing_time': 1774454400.0, 'created_time': 1774284565.441738, 'last_price_update_time': 1774371284.350529}
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977564') HTTP/1.1" 204 0
2026-03-24 16:54:44 [ayvens.fr] INFO: Found listing with ID: 1977565
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977565%27 HTTP/1.1" 200 None
2026-03-24 16:54:44 [ayvens.fr] INFO: Scrape type for 1977565: 2
2026-03-24 16:54:44 [ayvens.fr] INFO: Extracting data for car ID: 1977565
2026-03-24 16:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf322e5-7f9a-5c5f-a817-61526085b843 with identifier: 1977565
2026-03-24 16:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf322e5-7f9a-5c5f-a817-61526085b843 with scrape type 2
2026-03-24 16:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccf322e5-7f9a-5c5f-a817-61526085b843 with scrape type 2
2026-03-24 16:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ccf322e5-7f9a-5c5f-a817-61526085b843, identifier: 1977565
2026-03-24 16:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ccf322e5-7f9a-5c5f-a817-61526085b843 with identifier: 1977565
2026-03-24 16:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ccf322e5-7f9a-5c5f-a817-61526085b843 with identifier: 1977565
2026-03-24 16:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ccf322e5-7f9a-5c5f-a817-61526085b843 with identifier: 1977565 to the API
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'ccf322e5-7f9a-5c5f-a817-61526085b843',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 156661,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-03',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Fg L2H1 1300 2.0 dCi 120ch Grand Confort',
'transmission': 'manual',
'trim': 'Trafic Fg L2H1 1300 2.0 dCi 120ch Grand Confort',
'vin': None,
'year': 2019}
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977565%27 HTTP/1.1" 200 None
2026-03-24 16:54:44 [ayvens.fr] INFO: Saving data for 1977565: {'auction_closing_time': 1774454400.0, 'created_time': 1774284567.35011, 'last_price_update_time': 1774371284.701146}
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977565') HTTP/1.1" 204 0
2026-03-24 16:54:44 [ayvens.fr] INFO: Found listing with ID: 1977566
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977566%27 HTTP/1.1" 200 None
2026-03-24 16:54:44 [ayvens.fr] INFO: Scrape type for 1977566: 2
2026-03-24 16:54:44 [ayvens.fr] INFO: Extracting data for car ID: 1977566
2026-03-24 16:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b0a462-51c4-55af-bf88-50e56c5fb600 with identifier: 1977566
2026-03-24 16:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b0a462-51c4-55af-bf88-50e56c5fb600 with scrape type 2
2026-03-24 16:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b0a462-51c4-55af-bf88-50e56c5fb600 with scrape type 2
2026-03-24 16:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b7b0a462-51c4-55af-bf88-50e56c5fb600, identifier: 1977566
2026-03-24 16:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b7b0a462-51c4-55af-bf88-50e56c5fb600 with identifier: 1977566
2026-03-24 16:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b7b0a462-51c4-55af-bf88-50e56c5fb600 with identifier: 1977566
2026-03-24 16:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b7b0a462-51c4-55af-bf88-50e56c5fb600 with identifier: 1977566 to the API
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'BLANC BANQUISE OPAQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b7b0a462-51c4-55af-bf88-50e56c5fb600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPER',
'odometer': 173461,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-28',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPER Jumper Fg 30 L1H1 2.2 BlueHDi 120 S&S Driver',
'transmission': 'manual',
'trim': 'Jumper Fg 30 L1H1 2.2 BlueHDi 120 S&S Driver',
'vin': None,
'year': 2019}
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977566%27 HTTP/1.1" 200 None
2026-03-24 16:54:45 [ayvens.fr] INFO: Saving data for 1977566: {'auction_closing_time': 1774454400.0, 'created_time': 1774284568.943742, 'last_price_update_time': 1774371285.081375}
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977566') HTTP/1.1" 204 0
2026-03-24 16:54:45 [ayvens.fr] INFO: Found listing with ID: 1977567
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977567%27 HTTP/1.1" 200 None
2026-03-24 16:54:45 [ayvens.fr] INFO: Scrape type for 1977567: 2
2026-03-24 16:54:45 [ayvens.fr] INFO: Extracting data for car ID: 1977567
2026-03-24 16:54:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8f02ee1-b43f-582d-8581-a8e6b9f6327a with identifier: 1977567
2026-03-24 16:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f02ee1-b43f-582d-8581-a8e6b9f6327a with scrape type 2
2026-03-24 16:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8f02ee1-b43f-582d-8581-a8e6b9f6327a with scrape type 2
2026-03-24 16:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a8f02ee1-b43f-582d-8581-a8e6b9f6327a, identifier: 1977567
2026-03-24 16:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a8f02ee1-b43f-582d-8581-a8e6b9f6327a with identifier: 1977567
2026-03-24 16:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a8f02ee1-b43f-582d-8581-a8e6b9f6327a with identifier: 1977567
2026-03-24 16:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a8f02ee1-b43f-582d-8581-a8e6b9f6327a with identifier: 1977567 to the API
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'a8f02ee1-b43f-582d-8581-a8e6b9f6327a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'CADDY MAXI VAN',
'odometer': 167873,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-29',
'seats_number': 2,
'seller_name': None,
'title': 'VOLKSWAGEN CADDY MAXI VAN Caddy Van 2.0 TDI 122ch Business Line '
'4Motion',
'transmission': 'manual',
'trim': 'Caddy Van 2.0 TDI 122ch Business Line 4Motion',
'vin': None,
'year': 2019}
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977567%27 HTTP/1.1" 200 None
2026-03-24 16:54:45 [ayvens.fr] INFO: Saving data for 1977567: {'auction_closing_time': 1774454400.0, 'created_time': 1774284572.720609, 'last_price_update_time': 1774371285.476312}
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977567') HTTP/1.1" 204 0
2026-03-24 16:54:45 [ayvens.fr] INFO: Found listing with ID: 1977568
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977568%27 HTTP/1.1" 200 None
2026-03-24 16:54:45 [ayvens.fr] INFO: Scrape type for 1977568: 2
2026-03-24 16:54:45 [ayvens.fr] INFO: Extracting data for car ID: 1977568
2026-03-24 16:54:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc92709e-4983-5928-a44c-ed6b65790275 with identifier: 1977568
2026-03-24 16:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc92709e-4983-5928-a44c-ed6b65790275 with scrape type 2
2026-03-24 16:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc92709e-4983-5928-a44c-ed6b65790275 with scrape type 2
2026-03-24 16:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bc92709e-4983-5928-a44c-ed6b65790275, identifier: 1977568
2026-03-24 16:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bc92709e-4983-5928-a44c-ed6b65790275 with identifier: 1977568
2026-03-24 16:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bc92709e-4983-5928-a44c-ed6b65790275 with identifier: 1977568
2026-03-24 16:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bc92709e-4983-5928-a44c-ed6b65790275 with identifier: 1977568 to the API
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 160,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'bc92709e-4983-5928-a44c-ed6b65790275',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 149232,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 1000kg BlueHDi 130 S&S Club EAT8',
'transmission': 'automatic',
'trim': 'Berlingo Van M 1000kg BlueHDi 130 S&S Club EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977568%27 HTTP/1.1" 200 None
2026-03-24 16:54:45 [ayvens.fr] INFO: Saving data for 1977568: {'auction_closing_time': 1774454400.0, 'created_time': 1774284572.276519, 'last_price_update_time': 1774371285.850586}
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977568') HTTP/1.1" 204 0
2026-03-24 16:54:45 [ayvens.fr] INFO: Found listing with ID: 1977569
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977569%27 HTTP/1.1" 200 None
2026-03-24 16:54:45 [ayvens.fr] INFO: Scrape type for 1977569: 2
2026-03-24 16:54:45 [ayvens.fr] INFO: Extracting data for car ID: 1977569
2026-03-24 16:54:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 848e2fde-c0dc-5ad3-934a-e2813101002f with identifier: 1977569
2026-03-24 16:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 848e2fde-c0dc-5ad3-934a-e2813101002f with scrape type 2
2026-03-24 16:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 848e2fde-c0dc-5ad3-934a-e2813101002f with scrape type 2
2026-03-24 16:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 848e2fde-c0dc-5ad3-934a-e2813101002f, identifier: 1977569
2026-03-24 16:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 848e2fde-c0dc-5ad3-934a-e2813101002f with identifier: 1977569
2026-03-24 16:54:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 848e2fde-c0dc-5ad3-934a-e2813101002f with identifier: 1977569
2026-03-24 16:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 848e2fde-c0dc-5ad3-934a-e2813101002f with identifier: 1977569 to the API
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': 'GRIS S',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '848e2fde-c0dc-5ad3-934a-e2813101002f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE C BREAK',
'odometer': 169396,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE C BREAK Classe C Break 200 204ch Business Line',
'transmission': 'automatic',
'trim': 'Classe C Break 200 204ch Business Line',
'vin': None,
'year': 2022}
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977569%27 HTTP/1.1" 200 None
2026-03-24 16:54:46 [ayvens.fr] INFO: Saving data for 1977569: {'auction_closing_time': 1774454400.0, 'created_time': 1774284573.719502, 'last_price_update_time': 1774371286.450467}
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977569') HTTP/1.1" 204 0
2026-03-24 16:54:46 [ayvens.fr] INFO: Found listing with ID: 1977570
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977570%27 HTTP/1.1" 200 None
2026-03-24 16:54:46 [ayvens.fr] INFO: Scrape type for 1977570: 2
2026-03-24 16:54:46 [ayvens.fr] INFO: Extracting data for car ID: 1977570
2026-03-24 16:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a3bc9ac-846c-59b6-aa28-1818a9407142 with identifier: 1977570
2026-03-24 16:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3bc9ac-846c-59b6-aa28-1818a9407142 with scrape type 2
2026-03-24 16:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a3bc9ac-846c-59b6-aa28-1818a9407142 with scrape type 2
2026-03-24 16:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3a3bc9ac-846c-59b6-aa28-1818a9407142, identifier: 1977570
2026-03-24 16:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3a3bc9ac-846c-59b6-aa28-1818a9407142 with identifier: 1977570
2026-03-24 16:54:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3a3bc9ac-846c-59b6-aa28-1818a9407142 with identifier: 1977570
2026-03-24 16:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3a3bc9ac-846c-59b6-aa28-1818a9407142 with identifier: 1977570 to the API
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'BLEU ABYSSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3a3bc9ac-846c-59b6-aa28-1818a9407142',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'KUGA',
'odometer': 156065,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'FORD KUGA Kuga 2.5 Duratec 190ch FHEV E85 ST-Line Business BVA',
'transmission': 'automatic',
'trim': 'Kuga 2.5 Duratec 190ch FHEV E85 ST-Line Business BVA',
'vin': None,
'year': 2022}
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977570%27 HTTP/1.1" 200 None
2026-03-24 16:54:46 [ayvens.fr] INFO: Saving data for 1977570: {'auction_closing_time': 1774454400.0, 'created_time': 1774284575.144622, 'last_price_update_time': 1774371286.867808}
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977570') HTTP/1.1" 204 0
2026-03-24 16:54:46 [ayvens.fr] INFO: Found listing with ID: 1977571
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977571%27 HTTP/1.1" 200 None
2026-03-24 16:54:46 [ayvens.fr] INFO: Scrape type for 1977571: 2
2026-03-24 16:54:46 [ayvens.fr] INFO: Extracting data for car ID: 1977571
2026-03-24 16:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b854b5e5-e3ac-571b-947f-251fa1659c05 with identifier: 1977571
2026-03-24 16:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b854b5e5-e3ac-571b-947f-251fa1659c05 with scrape type 2
2026-03-24 16:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b854b5e5-e3ac-571b-947f-251fa1659c05 with scrape type 2
2026-03-24 16:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b854b5e5-e3ac-571b-947f-251fa1659c05, identifier: 1977571
2026-03-24 16:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b854b5e5-e3ac-571b-947f-251fa1659c05 with identifier: 1977571
2026-03-24 16:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b854b5e5-e3ac-571b-947f-251fa1659c05 with identifier: 1977571
2026-03-24 16:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b854b5e5-e3ac-571b-947f-251fa1659c05 with identifier: 1977571 to the API
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b854b5e5-e3ac-571b-947f-251fa1659c05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 212868,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-23',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 2.0 BlueHDi 120ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 2.0 BlueHDi 120ch S&S Club',
'vin': None,
'year': 2019}
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977571%27 HTTP/1.1" 200 None
2026-03-24 16:54:47 [ayvens.fr] INFO: Saving data for 1977571: {'auction_closing_time': 1774454400.0, 'created_time': 1774284576.069373, 'last_price_update_time': 1774371287.249679}
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977571') HTTP/1.1" 204 0
2026-03-24 16:54:47 [ayvens.fr] INFO: Found listing with ID: 1977572
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977572%27 HTTP/1.1" 200 None
2026-03-24 16:54:47 [ayvens.fr] INFO: Scrape type for 1977572: 2
2026-03-24 16:54:47 [ayvens.fr] INFO: Extracting data for car ID: 1977572
2026-03-24 16:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6107a79f-0be9-5b18-a456-3f7a055328f2 with identifier: 1977572
2026-03-24 16:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6107a79f-0be9-5b18-a456-3f7a055328f2 with scrape type 2
2026-03-24 16:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6107a79f-0be9-5b18-a456-3f7a055328f2 with scrape type 2
2026-03-24 16:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6107a79f-0be9-5b18-a456-3f7a055328f2, identifier: 1977572
2026-03-24 16:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6107a79f-0be9-5b18-a456-3f7a055328f2 with identifier: 1977572
2026-03-24 16:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6107a79f-0be9-5b18-a456-3f7a055328f2 with identifier: 1977572
2026-03-24 16:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6107a79f-0be9-5b18-a456-3f7a055328f2 with identifier: 1977572 to the API
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '6107a79f-0be9-5b18-a456-3f7a055328f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'MONDEO',
'odometer': 202960,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD MONDEO Mondeo SW 2.0 HYBRID 187ch Titanium BVA',
'transmission': 'automatic',
'trim': 'Mondeo SW 2.0 HYBRID 187ch Titanium BVA',
'vin': None,
'year': 2019}
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977572%27 HTTP/1.1" 200 None
2026-03-24 16:54:47 [ayvens.fr] INFO: Saving data for 1977572: {'auction_closing_time': 1774454400.0, 'created_time': 1774284577.393781, 'last_price_update_time': 1774371287.663657}
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977572') HTTP/1.1" 204 0
2026-03-24 16:54:47 [ayvens.fr] INFO: Found listing with ID: 1977573
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977573%27 HTTP/1.1" 200 None
2026-03-24 16:54:47 [ayvens.fr] INFO: Scrape type for 1977573: 2
2026-03-24 16:54:47 [ayvens.fr] INFO: Extracting data for car ID: 1977573
2026-03-24 16:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a65a568-796e-52d1-ac54-f37ae5d05519 with identifier: 1977573
2026-03-24 16:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a65a568-796e-52d1-ac54-f37ae5d05519 with scrape type 2
2026-03-24 16:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a65a568-796e-52d1-ac54-f37ae5d05519 with scrape type 2
2026-03-24 16:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3a65a568-796e-52d1-ac54-f37ae5d05519, identifier: 1977573
2026-03-24 16:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3a65a568-796e-52d1-ac54-f37ae5d05519 with identifier: 1977573
2026-03-24 16:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3a65a568-796e-52d1-ac54-f37ae5d05519 with identifier: 1977573
2026-03-24 16:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3a65a568-796e-52d1-ac54-f37ae5d05519 with identifier: 1977573 to the API
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '3a65a568-796e-52d1-ac54-f37ae5d05519',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 202172,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S Feel',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S Feel',
'vin': None,
'year': 2020}
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977573%27 HTTP/1.1" 200 None
2026-03-24 16:54:48 [ayvens.fr] INFO: Saving data for 1977573: {'auction_closing_time': 1774454400.0, 'created_time': 1774284578.694939, 'last_price_update_time': 1774371288.074212}
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977573') HTTP/1.1" 204 0
2026-03-24 16:54:48 [ayvens.fr] INFO: Found listing with ID: 1977574
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977574%27 HTTP/1.1" 200 None
2026-03-24 16:54:48 [ayvens.fr] INFO: Scrape type for 1977574: 2
2026-03-24 16:54:48 [ayvens.fr] INFO: Extracting data for car ID: 1977574
2026-03-24 16:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5374e8f0-ea06-5b85-a71f-24f92f88c5bb with identifier: 1977574
2026-03-24 16:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5374e8f0-ea06-5b85-a71f-24f92f88c5bb with scrape type 2
2026-03-24 16:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5374e8f0-ea06-5b85-a71f-24f92f88c5bb with scrape type 2
2026-03-24 16:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5374e8f0-ea06-5b85-a71f-24f92f88c5bb, identifier: 1977574
2026-03-24 16:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5374e8f0-ea06-5b85-a71f-24f92f88c5bb with identifier: 1977574
2026-03-24 16:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5374e8f0-ea06-5b85-a71f-24f92f88c5bb with identifier: 1977574
2026-03-24 16:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5374e8f0-ea06-5b85-a71f-24f92f88c5bb with identifier: 1977574 to the API
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 92,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '5374e8f0-ea06-5b85-a71f-24f92f88c5bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 BUSINESS R',
'odometer': 152314,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-13',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 308 BUSINESS R 308 SW Business R 1.5 BlueHDi 130 S&S Active',
'transmission': 'manual',
'trim': '308 SW Business R 1.5 BlueHDi 130 S&S Active',
'vin': None,
'year': 2019}
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977574%27 HTTP/1.1" 200 None
2026-03-24 16:54:48 [ayvens.fr] INFO: Saving data for 1977574: {'auction_closing_time': 1774454400.0, 'created_time': 1774284580.040723, 'last_price_update_time': 1774371288.447749}
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977574') HTTP/1.1" 204 0
2026-03-24 16:54:48 [ayvens.fr] INFO: Found listing with ID: 1977575
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977575%27 HTTP/1.1" 200 None
2026-03-24 16:54:48 [ayvens.fr] INFO: Scrape type for 1977575: 2
2026-03-24 16:54:48 [ayvens.fr] INFO: Extracting data for car ID: 1977575
2026-03-24 16:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f47b8d-80dc-5d5b-bd50-99f6103325c0 with identifier: 1977575
2026-03-24 16:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f47b8d-80dc-5d5b-bd50-99f6103325c0 with scrape type 2
2026-03-24 16:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f47b8d-80dc-5d5b-bd50-99f6103325c0 with scrape type 2
2026-03-24 16:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f8f47b8d-80dc-5d5b-bd50-99f6103325c0, identifier: 1977575
2026-03-24 16:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f8f47b8d-80dc-5d5b-bd50-99f6103325c0 with identifier: 1977575
2026-03-24 16:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f8f47b8d-80dc-5d5b-bd50-99f6103325c0 with identifier: 1977575
2026-03-24 16:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f8f47b8d-80dc-5d5b-bd50-99f6103325c0 with identifier: 1977575 to the API
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.3L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'electric',
'id': 'f8f47b8d-80dc-5d5b-bd50-99f6103325c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 152495,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Standard RWD Plus MY21',
'transmission': 'automatic',
'trim': 'Model 3 Standard RWD Plus MY21',
'vin': None,
'year': 2021}
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977575%27 HTTP/1.1" 200 None
2026-03-24 16:54:48 [ayvens.fr] INFO: Saving data for 1977575: {'auction_closing_time': 1774454400.0, 'created_time': 1774284581.149626, 'last_price_update_time': 1774371288.805741}
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977575') HTTP/1.1" 204 0
2026-03-24 16:54:48 [ayvens.fr] INFO: Found listing with ID: 1977576
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977576%27 HTTP/1.1" 200 None
2026-03-24 16:54:48 [ayvens.fr] INFO: Scrape type for 1977576: 2
2026-03-24 16:54:48 [ayvens.fr] INFO: Extracting data for car ID: 1977576
2026-03-24 16:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704 with identifier: 1977576
2026-03-24 16:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704 with scrape type 2
2026-03-24 16:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704 with scrape type 2
2026-03-24 16:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704, identifier: 1977576
2026-03-24 16:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704 with identifier: 1977576
2026-03-24 16:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704 with identifier: 1977576
2026-03-24 16:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704 with identifier: 1977576 to the API
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'ec2a24c4-d6be-5c7e-b8cf-2bdbeba8d704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 144752,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-17',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977576%27 HTTP/1.1" 200 None
2026-03-24 16:54:49 [ayvens.fr] INFO: Saving data for 1977576: {'auction_closing_time': 1774454400.0, 'created_time': 1774284583.526202, 'last_price_update_time': 1774371289.239178}
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977576') HTTP/1.1" 204 0
2026-03-24 16:54:49 [ayvens.fr] INFO: Found listing with ID: 1977577
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977577%27 HTTP/1.1" 200 None
2026-03-24 16:54:49 [ayvens.fr] INFO: Scrape type for 1977577: 2
2026-03-24 16:54:49 [ayvens.fr] INFO: Extracting data for car ID: 1977577
2026-03-24 16:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0cf387d-7839-519b-92ad-cfb10351f1de with identifier: 1977577
2026-03-24 16:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0cf387d-7839-519b-92ad-cfb10351f1de with scrape type 2
2026-03-24 16:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0cf387d-7839-519b-92ad-cfb10351f1de with scrape type 2
2026-03-24 16:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b0cf387d-7839-519b-92ad-cfb10351f1de, identifier: 1977577
2026-03-24 16:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b0cf387d-7839-519b-92ad-cfb10351f1de with identifier: 1977577
2026-03-24 16:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b0cf387d-7839-519b-92ad-cfb10351f1de with identifier: 1977577
2026-03-24 16:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b0cf387d-7839-519b-92ad-cfb10351f1de with identifier: 1977577 to the API
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b0cf387d-7839-519b-92ad-cfb10351f1de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SUPERB COMBI',
'odometer': 165161,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SUPERB COMBI Superb Combi 2.0 TDI 150ch SCR Business DSG7 '
'Euro6d-T EVAP',
'transmission': 'automatic',
'trim': 'Superb Combi 2.0 TDI 150ch SCR Business DSG7 Euro6d-T EVAP',
'vin': None,
'year': 2020}
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977577%27 HTTP/1.1" 200 None
2026-03-24 16:54:49 [ayvens.fr] INFO: Saving data for 1977577: {'auction_closing_time': 1774454400.0, 'created_time': 1774284584.866113, 'last_price_update_time': 1774371289.598786}
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977577') HTTP/1.1" 204 0
2026-03-24 16:54:49 [ayvens.fr] INFO: Found listing with ID: 1977578
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977578%27 HTTP/1.1" 200 None
2026-03-24 16:54:49 [ayvens.fr] INFO: Scrape type for 1977578: 2
2026-03-24 16:54:49 [ayvens.fr] INFO: Extracting data for car ID: 1977578
2026-03-24 16:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e213eb1c-79ad-5673-ba4f-e33715b0429a with identifier: 1977578
2026-03-24 16:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e213eb1c-79ad-5673-ba4f-e33715b0429a with scrape type 2
2026-03-24 16:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e213eb1c-79ad-5673-ba4f-e33715b0429a with scrape type 2
2026-03-24 16:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e213eb1c-79ad-5673-ba4f-e33715b0429a, identifier: 1977578
2026-03-24 16:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e213eb1c-79ad-5673-ba4f-e33715b0429a with identifier: 1977578
2026-03-24 16:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e213eb1c-79ad-5673-ba4f-e33715b0429a with identifier: 1977578
2026-03-24 16:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e213eb1c-79ad-5673-ba4f-e33715b0429a with identifier: 1977578 to the API
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'GRIS METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'e213eb1c-79ad-5673-ba4f-e33715b0429a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 156281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.3 TCe mild hybrid 140ch Evolution EDC -',
'transmission': 'automatic',
'trim': 'Arkana 1.3 TCe mild hybrid 140ch Evolution EDC -',
'vin': None,
'year': 2023}
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977578%27 HTTP/1.1" 200 None
2026-03-24 16:54:49 [ayvens.fr] INFO: Saving data for 1977578: {'auction_closing_time': 1774454400.0, 'created_time': 1774284586.681363, 'last_price_update_time': 1774371289.967513}
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977578') HTTP/1.1" 204 0
2026-03-24 16:54:49 [ayvens.fr] INFO: Found listing with ID: 1977579
2026-03-24 16:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977579%27 HTTP/1.1" 200 None
2026-03-24 16:54:50 [ayvens.fr] INFO: Scrape type for 1977579: 2
2026-03-24 16:54:50 [ayvens.fr] INFO: Extracting data for car ID: 1977579
2026-03-24 16:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f29c1834-3424-5327-9a80-af360694010c with identifier: 1977579
2026-03-24 16:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f29c1834-3424-5327-9a80-af360694010c with scrape type 2
2026-03-24 16:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f29c1834-3424-5327-9a80-af360694010c with scrape type 2
2026-03-24 16:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f29c1834-3424-5327-9a80-af360694010c, identifier: 1977579
2026-03-24 16:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f29c1834-3424-5327-9a80-af360694010c with identifier: 1977579
2026-03-24 16:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f29c1834-3424-5327-9a80-af360694010c with identifier: 1977579
2026-03-24 16:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f29c1834-3424-5327-9a80-af360694010c with identifier: 1977579 to the API
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': 'f29c1834-3424-5327-9a80-af360694010c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 145123,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2022}
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977579%27 HTTP/1.1" 200 None
2026-03-24 16:54:50 [ayvens.fr] INFO: Saving data for 1977579: {'auction_closing_time': 1774454400.0, 'created_time': 1774284588.247129, 'last_price_update_time': 1774371290.420549}
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977579') HTTP/1.1" 204 0
2026-03-24 16:54:50 [ayvens.fr] INFO: Found listing with ID: 1977580
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977580%27 HTTP/1.1" 200 None
2026-03-24 16:54:50 [ayvens.fr] INFO: Scrape type for 1977580: 2
2026-03-24 16:54:50 [ayvens.fr] INFO: Extracting data for car ID: 1977580
2026-03-24 16:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53084ae4-15c9-5ad7-957a-90520c463406 with identifier: 1977580
2026-03-24 16:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53084ae4-15c9-5ad7-957a-90520c463406 with scrape type 2
2026-03-24 16:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53084ae4-15c9-5ad7-957a-90520c463406 with scrape type 2
2026-03-24 16:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 53084ae4-15c9-5ad7-957a-90520c463406, identifier: 1977580
2026-03-24 16:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 53084ae4-15c9-5ad7-957a-90520c463406 with identifier: 1977580
2026-03-24 16:54:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 53084ae4-15c9-5ad7-957a-90520c463406 with identifier: 1977580
2026-03-24 16:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 53084ae4-15c9-5ad7-957a-90520c463406 with identifier: 1977580 to the API
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'EMERALD CRYSTAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'petrol',
'id': '53084ae4-15c9-5ad7-957a-90520c463406',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 157097,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch E6.3 Active Business S&S EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch E6.3 Active Business S&S EAT8',
'vin': None,
'year': 2019}
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977580%27 HTTP/1.1" 200 None
2026-03-24 16:54:50 [ayvens.fr] INFO: Saving data for 1977580: {'auction_closing_time': 1774454400.0, 'created_time': 1774284589.678403, 'last_price_update_time': 1774371290.925845}
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977580') HTTP/1.1" 204 0
2026-03-24 16:54:50 [ayvens.fr] INFO: Found listing with ID: 1977581
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977581%27 HTTP/1.1" 200 None
2026-03-24 16:54:50 [ayvens.fr] INFO: Scrape type for 1977581: 2
2026-03-24 16:54:50 [ayvens.fr] INFO: Extracting data for car ID: 1977581
2026-03-24 16:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e556d5a-26b4-5ae2-984c-afa2819f0f07 with identifier: 1977581
2026-03-24 16:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e556d5a-26b4-5ae2-984c-afa2819f0f07 with scrape type 2
2026-03-24 16:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e556d5a-26b4-5ae2-984c-afa2819f0f07 with scrape type 2
2026-03-24 16:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5e556d5a-26b4-5ae2-984c-afa2819f0f07, identifier: 1977581
2026-03-24 16:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5e556d5a-26b4-5ae2-984c-afa2819f0f07 with identifier: 1977581
2026-03-24 16:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5e556d5a-26b4-5ae2-984c-afa2819f0f07 with identifier: 1977581
2026-03-24 16:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5e556d5a-26b4-5ae2-984c-afa2819f0f07 with identifier: 1977581 to the API
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.5L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'electric',
'id': '5e556d5a-26b4-5ae2-984c-afa2819f0f07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 156790,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Long Range AWD',
'transmission': 'automatic',
'trim': 'Model Y Long Range AWD',
'vin': None,
'year': 2022}
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977581%27 HTTP/1.1" 200 None
2026-03-24 16:54:51 [ayvens.fr] INFO: Saving data for 1977581: {'auction_closing_time': 1774454400.0, 'created_time': 1774284590.048563, 'last_price_update_time': 1774371291.35385}
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977581') HTTP/1.1" 204 0
2026-03-24 16:54:51 [ayvens.fr] INFO: Found listing with ID: 1977582
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977582%27 HTTP/1.1" 200 None
2026-03-24 16:54:51 [ayvens.fr] INFO: Scrape type for 1977582: 2
2026-03-24 16:54:51 [ayvens.fr] INFO: Extracting data for car ID: 1977582
2026-03-24 16:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c708212c-a1c2-5430-85ae-19d98be74016 with identifier: 1977582
2026-03-24 16:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c708212c-a1c2-5430-85ae-19d98be74016 with scrape type 2
2026-03-24 16:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c708212c-a1c2-5430-85ae-19d98be74016 with scrape type 2
2026-03-24 16:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c708212c-a1c2-5430-85ae-19d98be74016, identifier: 1977582
2026-03-24 16:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c708212c-a1c2-5430-85ae-19d98be74016 with identifier: 1977582
2026-03-24 16:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c708212c-a1c2-5430-85ae-19d98be74016 with identifier: 1977582
2026-03-24 16:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c708212c-a1c2-5430-85ae-19d98be74016 with identifier: 1977582 to the API
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'c708212c-a1c2-5430-85ae-19d98be74016',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 149981,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-10',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'vin': None,
'year': 2022}
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977582%27 HTTP/1.1" 200 None
2026-03-24 16:54:51 [ayvens.fr] INFO: Saving data for 1977582: {'auction_closing_time': 1774454400.0, 'created_time': 1774284591.445998, 'last_price_update_time': 1774371291.748633}
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977582') HTTP/1.1" 204 0
2026-03-24 16:54:51 [ayvens.fr] INFO: Found listing with ID: 1977583
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977583%27 HTTP/1.1" 200 None
2026-03-24 16:54:51 [ayvens.fr] INFO: Scrape type for 1977583: 2
2026-03-24 16:54:51 [ayvens.fr] INFO: Extracting data for car ID: 1977583
2026-03-24 16:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770bd697-73e1-51af-94d0-47652fddd3a2 with identifier: 1977583
2026-03-24 16:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770bd697-73e1-51af-94d0-47652fddd3a2 with scrape type 2
2026-03-24 16:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770bd697-73e1-51af-94d0-47652fddd3a2 with scrape type 2
2026-03-24 16:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 770bd697-73e1-51af-94d0-47652fddd3a2, identifier: 1977583
2026-03-24 16:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 770bd697-73e1-51af-94d0-47652fddd3a2 with identifier: 1977583
2026-03-24 16:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 770bd697-73e1-51af-94d0-47652fddd3a2 with identifier: 1977583
2026-03-24 16:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 770bd697-73e1-51af-94d0-47652fddd3a2 with identifier: 1977583 to the API
2026-03-24 16:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'BLANC NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '770bd697-73e1-51af-94d0-47652fddd3a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 145390,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 CRDi 136ch MHEV Black Edition 4x2 DCT7',
'transmission': 'automatic',
'trim': 'Sportage 1.6 CRDi 136ch MHEV Black Edition 4x2 DCT7',
'vin': None,
'year': 2021}
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977583%27 HTTP/1.1" 200 None
2026-03-24 16:54:52 [ayvens.fr] INFO: Saving data for 1977583: {'auction_closing_time': 1774454400.0, 'created_time': 1774284592.963974, 'last_price_update_time': 1774371292.171622}
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977583') HTTP/1.1" 204 0
2026-03-24 16:54:52 [ayvens.fr] INFO: Found listing with ID: 1977584
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977584%27 HTTP/1.1" 200 None
2026-03-24 16:54:52 [ayvens.fr] INFO: Scrape type for 1977584: 2
2026-03-24 16:54:52 [ayvens.fr] INFO: Extracting data for car ID: 1977584
2026-03-24 16:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e265a32a-4244-57d7-9c54-0919694c5235 with identifier: 1977584
2026-03-24 16:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e265a32a-4244-57d7-9c54-0919694c5235 with scrape type 2
2026-03-24 16:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e265a32a-4244-57d7-9c54-0919694c5235 with scrape type 2
2026-03-24 16:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e265a32a-4244-57d7-9c54-0919694c5235, identifier: 1977584
2026-03-24 16:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e265a32a-4244-57d7-9c54-0919694c5235 with identifier: 1977584
2026-03-24 16:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e265a32a-4244-57d7-9c54-0919694c5235 with identifier: 1977584
2026-03-24 16:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e265a32a-4244-57d7-9c54-0919694c5235 with identifier: 1977584 to the API
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': 'e265a32a-4244-57d7-9c54-0919694c5235',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 184660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-12',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 2.0 TDI SCR 150ch R-Line DSG7',
'transmission': 'automatic',
'trim': 'Golf 2.0 TDI SCR 150ch R-Line DSG7',
'vin': None,
'year': 2022}
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977584%27 HTTP/1.1" 200 None
2026-03-24 16:54:52 [ayvens.fr] INFO: Saving data for 1977584: {'auction_closing_time': 1774454400.0, 'created_time': 1774284594.52352, 'last_price_update_time': 1774371292.607445}
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977584') HTTP/1.1" 204 0
2026-03-24 16:54:52 [ayvens.fr] INFO: Found listing with ID: 1977585
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977585%27 HTTP/1.1" 200 None
2026-03-24 16:54:52 [ayvens.fr] INFO: Scrape type for 1977585: 2
2026-03-24 16:54:52 [ayvens.fr] INFO: Extracting data for car ID: 1977585
2026-03-24 16:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627cda9a-c42c-5a30-b766-83106c86c743 with identifier: 1977585
2026-03-24 16:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627cda9a-c42c-5a30-b766-83106c86c743 with scrape type 2
2026-03-24 16:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627cda9a-c42c-5a30-b766-83106c86c743 with scrape type 2
2026-03-24 16:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 627cda9a-c42c-5a30-b766-83106c86c743, identifier: 1977585
2026-03-24 16:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 627cda9a-c42c-5a30-b766-83106c86c743 with identifier: 1977585
2026-03-24 16:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 627cda9a-c42c-5a30-b766-83106c86c743 with identifier: 1977585
2026-03-24 16:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 627cda9a-c42c-5a30-b766-83106c86c743 with identifier: 1977585 to the API
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '627cda9a-c42c-5a30-b766-83106c86c743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 146913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-10',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Club',
'vin': None,
'year': 2019}
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977585%27 HTTP/1.1" 200 None
2026-03-24 16:54:52 [ayvens.fr] INFO: Saving data for 1977585: {'auction_closing_time': 1774454400.0, 'created_time': 1774284595.722432, 'last_price_update_time': 1774371292.98918}
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977585') HTTP/1.1" 204 0
2026-03-24 16:54:53 [ayvens.fr] INFO: Found listing with ID: 1977586
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977586%27 HTTP/1.1" 200 None
2026-03-24 16:54:53 [ayvens.fr] INFO: Scrape type for 1977586: 2
2026-03-24 16:54:53 [ayvens.fr] INFO: Extracting data for car ID: 1977586
2026-03-24 16:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 427c3b3e-0ae7-5736-9c55-735754dd7037 with identifier: 1977586
2026-03-24 16:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 427c3b3e-0ae7-5736-9c55-735754dd7037 with scrape type 2
2026-03-24 16:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 427c3b3e-0ae7-5736-9c55-735754dd7037 with scrape type 2
2026-03-24 16:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 427c3b3e-0ae7-5736-9c55-735754dd7037, identifier: 1977586
2026-03-24 16:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 427c3b3e-0ae7-5736-9c55-735754dd7037 with identifier: 1977586
2026-03-24 16:54:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 16:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 427c3b3e-0ae7-5736-9c55-735754dd7037 with identifier: 1977586
2026-03-24 16:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 427c3b3e-0ae7-5736-9c55-735754dd7037 with identifier: 1977586 to the API
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS REFLET D',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '427c3b3e-0ae7-5736-9c55-735754dd7037',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 167888,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf Sté 1.0 eTSI OPF 110ch Life Business 1st '
'Société Réversible DSG7',
'transmission': 'automatic',
'trim': 'Golf Sté 1.0 eTSI OPF 110ch Life Business 1st Société Réversible '
'DSG7',
'vin': None,
'year': 2021}
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977586%27 HTTP/1.1" 200 None
2026-03-24 16:54:53 [ayvens.fr] INFO: Saving data for 1977586: {'auction_closing_time': 1774454400.0, 'created_time': 1774284597.814092, 'last_price_update_time': 1774371293.421369}
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977586') HTTP/1.1" 204 0
2026-03-24 16:54:53 [ayvens.fr] INFO: Found listing with ID: 1977587
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977587%27 HTTP/1.1" 200 None
2026-03-24 16:54:53 [ayvens.fr] INFO: Scrape type for 1977587: 2
2026-03-24 16:54:53 [ayvens.fr] INFO: Extracting data for car ID: 1977587
2026-03-24 16:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31622911-35f9-593b-8350-870dfeedc448 with identifier: 1977587
2026-03-24 16:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31622911-35f9-593b-8350-870dfeedc448 with scrape type 2
2026-03-24 16:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31622911-35f9-593b-8350-870dfeedc448 with scrape type 2
2026-03-24 16:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 31622911-35f9-593b-8350-870dfeedc448, identifier: 1977587
2026-03-24 16:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 31622911-35f9-593b-8350-870dfeedc448 with identifier: 1977587
2026-03-24 16:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 31622911-35f9-593b-8350-870dfeedc448 with identifier: 1977587
2026-03-24 16:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 31622911-35f9-593b-8350-870dfeedc448 with identifier: 1977587 to the API
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 16:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS HIGHLAND',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-25T16:00:00Z',
'fuel_type': 'diesel',
'id': '31622911-35f9-593b-8350-870dfeedc448',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40923',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 171174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KADJAR Kadjar 1.5 Blue dCi 115ch Business EDC',
'transmission': 'automatic',
'trim': 'Kadjar 1.5 Blue dCi 115ch Business EDC',
'vin': None,
'year': 2021}
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271977587%27 HTTP/1.1" 200 None
2026-03-24 16:54:53 [ayvens.fr] INFO: Saving data for 1977587: {'auction_closing_time': 1774454400.0, 'created_time': 1774284598.997217, 'last_price_update_time': 1774371293.806325}
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1977587') HTTP/1.1" 204 0
2026-03-24 16:54:53 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-24 16:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 16:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 16:54:58 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-24 16:54:58 [ayvens.fr] INFO: ayvens.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 8, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-24 16:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 16:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20last_price_update_time%20lt%201773939298 HTTP/1.1" 200 None
2026-03-24 16:54:59 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (487 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.fr/task_44_2026-03-24T16_45_00.jl
2026-03-24 16:54:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1129750,
'downloader/request_count': 2431,
'downloader/request_method_count/GET': 2425,
'downloader/request_method_count/POST': 6,
'downloader/response_bytes': 877921423,
'downloader/response_count': 2431,
'downloader/response_status_count/200': 2431,
'elapsed_time_seconds': 592.48748,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 24, 16, 54, 59, 165932, tzinfo=datetime.timezone.utc),
'item_scraped_count': 487,
'log_count/DEBUG': 22077,
'log_count/ERROR': 3,
'log_count/INFO': 23128,
'memusage/max': 190734336,
'memusage/startup': 150319104,
'photo_download_count': 2424,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 138,
'playwright/request_count/aborted': 12,
'playwright/request_count/method/GET': 134,
'playwright/request_count/method/POST': 4,
'playwright/request_count/navigation': 2,
'playwright/request_count/resource_type/document': 2,
'playwright/request_count/resource_type/fetch': 6,
'playwright/request_count/resource_type/font': 16,
'playwright/request_count/resource_type/image': 27,
'playwright/request_count/resource_type/script': 81,
'playwright/request_count/resource_type/stylesheet': 1,
'playwright/request_count/resource_type/xhr': 5,
'playwright/response_count': 121,
'playwright/response_count/method/GET': 118,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/fetch': 5,
'playwright/response_count/resource_type/font': 16,
'playwright/response_count/resource_type/image': 13,
'playwright/response_count/resource_type/script': 80,
'playwright/response_count/resource_type/stylesheet': 1,
'playwright/response_count/resource_type/xhr': 4,
'request_depth_max': 6,
'response_received_count': 7,
'scheduler/dequeued': 2431,
'scheduler/dequeued/memory': 2431,
'scheduler/enqueued': 2431,
'scheduler/enqueued/memory': 2431,
'scrape_type/new': 303,
'scrape_type/price_update': 184,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 6,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 4.47431820910424,
'scrapy-zyte-api/mean_response_seconds': 4.578089918320377,
'scrapy-zyte-api/processed': 6,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
'scrapy-zyte-api/request_args/httpRequestBody': 6,
'scrapy-zyte-api/request_args/httpRequestMethod': 6,
'scrapy-zyte-api/request_args/httpResponseBody': 6,
'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
'scrapy-zyte-api/request_args/url': 6,
'scrapy-zyte-api/status_codes/200': 6,
'scrapy-zyte-api/success': 6,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 24, 16, 45, 6, 678452, tzinfo=datetime.timezone.utc)}
2026-03-24 16:54:59 [scrapy.core.engine] INFO: Spider closed (finished)